2023-07-12 13:37:59,582 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta timeout: 13 mins 2023-07-12 13:37:59,626 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.procedure.TestSCPWithMeta#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=9, OpenFileDescriptor=256, MaxFileDescriptor=60000, SystemLoadAverage=476, ProcessCount=174, AvailableMemoryMB=3807 2023-07-12 13:37:59,931 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53 2023-07-12 13:37:59,935 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 13:37:59,936 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/cluster_3e57dbce-1243-5245-5db7-0568de051540, deleteOnExit=true 2023-07-12 13:37:59,936 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 13:37:59,937 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/test.cache.data in system properties and HBase conf 2023-07-12 13:37:59,937 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 13:37:59,938 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/hadoop.log.dir in system properties and HBase conf 2023-07-12 13:37:59,938 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 13:37:59,939 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 13:37:59,939 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 13:38:00,062 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 13:38:00,590 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 13:38:00,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 13:38:00,602 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 13:38:00,602 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 13:38:00,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 13:38:00,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 13:38:00,604 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 13:38:00,604 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 13:38:00,605 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 13:38:00,606 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 13:38:00,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/nfs.dump.dir in system properties and HBase conf 2023-07-12 13:38:00,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/java.io.tmpdir in system properties and HBase conf 2023-07-12 13:38:00,609 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 13:38:00,609 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 13:38:00,610 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 13:38:01,485 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 13:38:01,493 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 13:38:02,009 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 13:38:02,326 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 13:38:02,348 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 13:38:02,415 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 13:38:02,473 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/java.io.tmpdir/Jetty_localhost_localdomain_46147_hdfs____k3fp1o/webapp 2023-07-12 13:38:02,695 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:46147 2023-07-12 13:38:02,707 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 13:38:02,707 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 13:38:03,746 WARN [Listener at localhost.localdomain/43791] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 13:38:04,154 WARN [Listener at localhost.localdomain/43791] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 13:38:04,212 WARN [Listener at localhost.localdomain/43791] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 13:38:04,234 INFO [Listener at localhost.localdomain/43791] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 13:38:04,265 INFO [Listener at localhost.localdomain/43791] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/java.io.tmpdir/Jetty_localhost_41867_datanode____.m1gwjh/webapp 2023-07-12 13:38:04,393 INFO [Listener at localhost.localdomain/43791] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41867 2023-07-12 13:38:04,890 WARN [Listener at localhost.localdomain/37241] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 13:38:05,016 WARN [Listener at localhost.localdomain/37241] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 13:38:05,020 WARN [Listener at localhost.localdomain/37241] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 13:38:05,022 INFO [Listener at localhost.localdomain/37241] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 13:38:05,031 INFO [Listener at localhost.localdomain/37241] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/java.io.tmpdir/Jetty_localhost_44427_datanode____semvs0/webapp 2023-07-12 13:38:05,191 INFO [Listener at localhost.localdomain/37241] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44427 2023-07-12 13:38:05,249 WARN [Listener at localhost.localdomain/42083] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 13:38:05,410 WARN [Listener at localhost.localdomain/42083] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 13:38:05,414 WARN [Listener at localhost.localdomain/42083] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 13:38:05,417 INFO [Listener at localhost.localdomain/42083] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 13:38:05,444 INFO [Listener at localhost.localdomain/42083] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/java.io.tmpdir/Jetty_localhost_42513_datanode____qyqdz4/webapp 2023-07-12 13:38:05,648 INFO [Listener at localhost.localdomain/42083] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42513 2023-07-12 13:38:05,668 WARN [Listener at localhost.localdomain/40361] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 13:38:06,127 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa30bb7288c6282ec: Processing first storage report for DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0 from datanode ad128a13-2207-44e4-876a-b304c8dfdccd 2023-07-12 13:38:06,129 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa30bb7288c6282ec: from storage DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0 node DatanodeRegistration(127.0.0.1:46487, datanodeUuid=ad128a13-2207-44e4-876a-b304c8dfdccd, infoPort=33811, infoSecurePort=0, ipcPort=37241, storageInfo=lv=-57;cid=testClusterID;nsid=408664857;c=1689169081637), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-12 13:38:06,129 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7bf4e7e2377dcb60: Processing first storage report for DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8 from datanode 4a662cde-b7d6-4b53-8fec-ac6f9be1e65c 2023-07-12 13:38:06,129 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7bf4e7e2377dcb60: from storage DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8 node DatanodeRegistration(127.0.0.1:41091, datanodeUuid=4a662cde-b7d6-4b53-8fec-ac6f9be1e65c, infoPort=35615, infoSecurePort=0, ipcPort=40361, storageInfo=lv=-57;cid=testClusterID;nsid=408664857;c=1689169081637), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 13:38:06,130 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7541d6eec2fd940c: Processing first storage report for DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae from datanode 0d3c2b17-d056-4e6b-9464-9758b120b6cb 2023-07-12 13:38:06,130 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7541d6eec2fd940c: from storage DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae node DatanodeRegistration(127.0.0.1:44153, datanodeUuid=0d3c2b17-d056-4e6b-9464-9758b120b6cb, infoPort=38547, infoSecurePort=0, ipcPort=42083, storageInfo=lv=-57;cid=testClusterID;nsid=408664857;c=1689169081637), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 13:38:06,130 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa30bb7288c6282ec: Processing first storage report for DS-6e3ce609-11ee-4887-ba79-8967480e29a8 from datanode ad128a13-2207-44e4-876a-b304c8dfdccd 2023-07-12 13:38:06,130 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa30bb7288c6282ec: from storage DS-6e3ce609-11ee-4887-ba79-8967480e29a8 node DatanodeRegistration(127.0.0.1:46487, datanodeUuid=ad128a13-2207-44e4-876a-b304c8dfdccd, infoPort=33811, infoSecurePort=0, ipcPort=37241, storageInfo=lv=-57;cid=testClusterID;nsid=408664857;c=1689169081637), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 13:38:06,130 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7bf4e7e2377dcb60: Processing first storage report for DS-fbf2bfee-d08a-44d8-8336-008d18308614 from datanode 4a662cde-b7d6-4b53-8fec-ac6f9be1e65c 2023-07-12 13:38:06,130 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7bf4e7e2377dcb60: from storage DS-fbf2bfee-d08a-44d8-8336-008d18308614 node DatanodeRegistration(127.0.0.1:41091, datanodeUuid=4a662cde-b7d6-4b53-8fec-ac6f9be1e65c, infoPort=35615, infoSecurePort=0, ipcPort=40361, storageInfo=lv=-57;cid=testClusterID;nsid=408664857;c=1689169081637), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 13:38:06,131 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7541d6eec2fd940c: Processing first storage report for DS-5063f500-00eb-4b73-b37e-357a937a1d10 from datanode 0d3c2b17-d056-4e6b-9464-9758b120b6cb 2023-07-12 13:38:06,131 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7541d6eec2fd940c: from storage DS-5063f500-00eb-4b73-b37e-357a937a1d10 node DatanodeRegistration(127.0.0.1:44153, datanodeUuid=0d3c2b17-d056-4e6b-9464-9758b120b6cb, infoPort=38547, infoSecurePort=0, ipcPort=42083, storageInfo=lv=-57;cid=testClusterID;nsid=408664857;c=1689169081637), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 13:38:06,482 DEBUG [Listener at localhost.localdomain/40361] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53 2023-07-12 13:38:06,615 INFO [Listener at localhost.localdomain/40361] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/cluster_3e57dbce-1243-5245-5db7-0568de051540/zookeeper_0, clientPort=56143, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/cluster_3e57dbce-1243-5245-5db7-0568de051540/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/cluster_3e57dbce-1243-5245-5db7-0568de051540/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 13:38:06,658 INFO [Listener at localhost.localdomain/40361] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56143 2023-07-12 13:38:06,697 INFO [Listener at localhost.localdomain/40361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:38:06,703 INFO [Listener at localhost.localdomain/40361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:38:07,582 INFO [Listener at localhost.localdomain/40361] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9 with version=8 2023-07-12 13:38:07,582 INFO [Listener at localhost.localdomain/40361] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/hbase-staging 2023-07-12 13:38:08,123 INFO [Listener at localhost.localdomain/40361] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 13:38:08,561 INFO [Listener at localhost.localdomain/40361] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-12 13:38:08,591 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:08,591 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:08,592 INFO [Listener at localhost.localdomain/40361] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 13:38:08,592 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:08,592 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 13:38:08,783 INFO [Listener at localhost.localdomain/40361] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 13:38:08,891 DEBUG [Listener at localhost.localdomain/40361] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 13:38:08,995 INFO [Listener at localhost.localdomain/40361] ipc.NettyRpcServer(120): Bind to /136.243.18.41:42137 2023-07-12 13:38:09,010 INFO [Listener at localhost.localdomain/40361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:38:09,012 INFO [Listener at localhost.localdomain/40361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:38:09,033 INFO [Listener at localhost.localdomain/40361] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42137 connecting to ZooKeeper ensemble=127.0.0.1:56143 2023-07-12 13:38:09,071 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:421370x0, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 13:38:09,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42137-0x10159c043900000 connected 2023-07-12 13:38:09,094 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 13:38:09,095 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 13:38:09,098 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 13:38:09,106 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42137 2023-07-12 13:38:09,108 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42137 2023-07-12 13:38:09,109 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42137 2023-07-12 13:38:09,110 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42137 2023-07-12 13:38:09,112 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42137 2023-07-12 13:38:09,119 INFO [Listener at localhost.localdomain/40361] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9, hbase.cluster.distributed=false 2023-07-12 13:38:09,183 INFO [Listener at localhost.localdomain/40361] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-12 13:38:09,183 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:09,183 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:09,183 INFO [Listener at localhost.localdomain/40361] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 13:38:09,183 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:09,183 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 13:38:09,187 INFO [Listener at localhost.localdomain/40361] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 13:38:09,190 INFO [Listener at localhost.localdomain/40361] ipc.NettyRpcServer(120): Bind to /136.243.18.41:39081 2023-07-12 13:38:09,192 INFO [Listener at localhost.localdomain/40361] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 13:38:09,197 DEBUG [Listener at localhost.localdomain/40361] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 13:38:09,198 INFO [Listener at localhost.localdomain/40361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:38:09,200 INFO [Listener at localhost.localdomain/40361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:38:09,202 INFO [Listener at localhost.localdomain/40361] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39081 connecting to ZooKeeper ensemble=127.0.0.1:56143 2023-07-12 13:38:09,205 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:390810x0, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 13:38:09,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39081-0x10159c043900001 connected 2023-07-12 13:38:09,207 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 13:38:09,208 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 13:38:09,209 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 13:38:09,209 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39081 2023-07-12 13:38:09,210 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39081 2023-07-12 13:38:09,210 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39081 2023-07-12 13:38:09,211 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39081 2023-07-12 13:38:09,211 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39081 2023-07-12 13:38:09,224 INFO [Listener at localhost.localdomain/40361] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-12 13:38:09,224 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:09,225 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:09,225 INFO [Listener at localhost.localdomain/40361] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 13:38:09,225 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:09,225 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 13:38:09,226 INFO [Listener at localhost.localdomain/40361] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 13:38:09,227 INFO [Listener at localhost.localdomain/40361] ipc.NettyRpcServer(120): Bind to /136.243.18.41:34091 2023-07-12 13:38:09,228 INFO [Listener at localhost.localdomain/40361] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 13:38:09,229 DEBUG [Listener at localhost.localdomain/40361] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 13:38:09,229 INFO [Listener at localhost.localdomain/40361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:38:09,232 INFO [Listener at localhost.localdomain/40361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:38:09,235 INFO [Listener at localhost.localdomain/40361] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34091 connecting to ZooKeeper ensemble=127.0.0.1:56143 2023-07-12 13:38:09,237 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:340910x0, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 13:38:09,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34091-0x10159c043900002 connected 2023-07-12 13:38:09,239 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 13:38:09,240 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 13:38:09,241 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 13:38:09,242 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34091 2023-07-12 13:38:09,244 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34091 2023-07-12 13:38:09,245 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34091 2023-07-12 13:38:09,246 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34091 2023-07-12 13:38:09,247 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34091 2023-07-12 13:38:09,257 INFO [Listener at localhost.localdomain/40361] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-12 13:38:09,257 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:09,257 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:09,257 INFO [Listener at localhost.localdomain/40361] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 13:38:09,257 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 13:38:09,258 INFO [Listener at localhost.localdomain/40361] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 13:38:09,258 INFO [Listener at localhost.localdomain/40361] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 13:38:09,260 INFO [Listener at localhost.localdomain/40361] ipc.NettyRpcServer(120): Bind to /136.243.18.41:35445 2023-07-12 13:38:09,260 INFO [Listener at localhost.localdomain/40361] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 13:38:09,262 DEBUG [Listener at localhost.localdomain/40361] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 13:38:09,264 INFO [Listener at localhost.localdomain/40361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:38:09,265 INFO [Listener at localhost.localdomain/40361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:38:09,267 INFO [Listener at localhost.localdomain/40361] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35445 connecting to ZooKeeper ensemble=127.0.0.1:56143 2023-07-12 13:38:09,270 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:354450x0, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 13:38:09,271 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): regionserver:354450x0, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 13:38:09,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35445-0x10159c043900003 connected 2023-07-12 13:38:09,272 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 13:38:09,273 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ZKUtil(164): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 13:38:09,276 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35445 2023-07-12 13:38:09,276 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35445 2023-07-12 13:38:09,276 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35445 2023-07-12 13:38:09,277 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35445 2023-07-12 13:38:09,277 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35445 2023-07-12 13:38:09,279 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,42137,1689169087924 2023-07-12 13:38:09,286 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 13:38:09,287 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,42137,1689169087924 2023-07-12 13:38:09,302 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 13:38:09,302 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 13:38:09,302 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 13:38:09,302 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 13:38:09,303 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:38:09,304 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 13:38:09,305 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,42137,1689169087924 from backup master directory 2023-07-12 13:38:09,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 13:38:09,309 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,42137,1689169087924 2023-07-12 13:38:09,309 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 13:38:09,310 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 13:38:09,310 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,42137,1689169087924 2023-07-12 13:38:09,313 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 13:38:09,314 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 13:38:09,411 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/hbase.id with ID: ab905a1d-97a1-4fe0-86f4-b99ed4f6259d 2023-07-12 13:38:09,462 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 13:38:09,477 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:38:09,560 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x53bcf140 to 127.0.0.1:56143 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:38:09,592 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@293b8e12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:38:09,612 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 13:38:09,614 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 13:38:09,628 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 13:38:09,628 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 13:38:09,630 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:09,634 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:09,635 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 13:38:09,666 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/data/master/store-tmp 2023-07-12 13:38:09,705 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:09,706 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 13:38:09,706 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:38:09,706 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:38:09,706 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 13:38:09,706 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:38:09,706 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:38:09,706 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 13:38:09,708 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/WALs/jenkins-hbase17.apache.org,42137,1689169087924 2023-07-12 13:38:09,732 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C42137%2C1689169087924, suffix=, logDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/WALs/jenkins-hbase17.apache.org,42137,1689169087924, archiveDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/oldWALs, maxLogs=10 2023-07-12 13:38:09,789 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK] 2023-07-12 13:38:09,789 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK] 2023-07-12 13:38:09,789 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK] 2023-07-12 13:38:09,796 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:09,880 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/WALs/jenkins-hbase17.apache.org,42137,1689169087924/jenkins-hbase17.apache.org%2C42137%2C1689169087924.1689169089740 2023-07-12 13:38:09,884 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK], DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK], DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK]] 2023-07-12 13:38:09,885 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:38:09,886 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:09,889 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:38:09,891 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:38:09,996 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:38:10,011 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 13:38:10,071 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 13:38:10,091 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:10,098 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:38:10,100 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:38:10,117 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 13:38:10,122 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:10,123 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73744705, jitterRate=0.09888173639774323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:38:10,123 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 13:38:10,125 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 13:38:10,141 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 13:38:10,141 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 13:38:10,143 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 13:38:10,145 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 13:38:10,179 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-07-12 13:38:10,180 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 13:38:10,206 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 13:38:10,211 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 13:38:10,234 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 13:38:10,237 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 13:38:10,238 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 13:38:10,243 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 13:38:10,247 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 13:38:10,249 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:38:10,251 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 13:38:10,252 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 13:38:10,267 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 13:38:10,272 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 13:38:10,272 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 13:38:10,272 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 13:38:10,272 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 13:38:10,272 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:38:10,273 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,42137,1689169087924, sessionid=0x10159c043900000, setting cluster-up flag (Was=false) 2023-07-12 13:38:10,289 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:38:10,293 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 13:38:10,294 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,42137,1689169087924 2023-07-12 13:38:10,299 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:38:10,302 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 13:38:10,303 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,42137,1689169087924 2023-07-12 13:38:10,306 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.hbase-snapshot/.tmp 2023-07-12 13:38:10,381 INFO [RS:0;jenkins-hbase17:39081] regionserver.HRegionServer(951): ClusterId : ab905a1d-97a1-4fe0-86f4-b99ed4f6259d 2023-07-12 13:38:10,382 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(951): ClusterId : ab905a1d-97a1-4fe0-86f4-b99ed4f6259d 2023-07-12 13:38:10,384 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(951): ClusterId : ab905a1d-97a1-4fe0-86f4-b99ed4f6259d 2023-07-12 13:38:10,390 DEBUG [RS:2;jenkins-hbase17:35445] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 13:38:10,390 DEBUG [RS:1;jenkins-hbase17:34091] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 13:38:10,390 DEBUG [RS:0;jenkins-hbase17:39081] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 13:38:10,396 DEBUG [RS:1;jenkins-hbase17:34091] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 13:38:10,396 DEBUG [RS:2;jenkins-hbase17:35445] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 13:38:10,396 DEBUG [RS:0;jenkins-hbase17:39081] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 13:38:10,396 DEBUG [RS:2;jenkins-hbase17:35445] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 13:38:10,396 DEBUG [RS:1;jenkins-hbase17:34091] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 13:38:10,396 DEBUG [RS:0;jenkins-hbase17:39081] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 13:38:10,399 DEBUG [RS:1;jenkins-hbase17:34091] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 13:38:10,401 DEBUG [RS:1;jenkins-hbase17:34091] zookeeper.ReadOnlyZKClient(139): Connect 0x560f95b6 to 127.0.0.1:56143 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:38:10,402 DEBUG [RS:2;jenkins-hbase17:35445] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 13:38:10,403 DEBUG [RS:0;jenkins-hbase17:39081] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 13:38:10,403 DEBUG [RS:2;jenkins-hbase17:35445] zookeeper.ReadOnlyZKClient(139): Connect 0x30d81752 to 127.0.0.1:56143 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:38:10,408 DEBUG [RS:0;jenkins-hbase17:39081] zookeeper.ReadOnlyZKClient(139): Connect 0x03afb92e to 127.0.0.1:56143 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:38:10,414 DEBUG [RS:2;jenkins-hbase17:35445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e1fef39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:38:10,414 DEBUG [RS:1;jenkins-hbase17:34091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58c86107, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:38:10,414 DEBUG [RS:2;jenkins-hbase17:35445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a207c22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-12 13:38:10,415 DEBUG [RS:1;jenkins-hbase17:34091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cf7fec6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-12 13:38:10,415 DEBUG [RS:0;jenkins-hbase17:39081] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d68572b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:38:10,415 DEBUG [RS:0;jenkins-hbase17:39081] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@957d25e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-12 13:38:10,440 DEBUG [RS:2;jenkins-hbase17:35445] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase17:35445 2023-07-12 13:38:10,442 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 13:38:10,443 DEBUG [RS:0;jenkins-hbase17:39081] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:39081 2023-07-12 13:38:10,444 DEBUG [RS:1;jenkins-hbase17:34091] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase17:34091 2023-07-12 13:38:10,444 INFO [RS:2;jenkins-hbase17:35445] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 13:38:10,444 INFO [RS:1;jenkins-hbase17:34091] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 13:38:10,444 INFO [RS:0;jenkins-hbase17:39081] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 13:38:10,445 INFO [RS:0;jenkins-hbase17:39081] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 13:38:10,445 INFO [RS:1;jenkins-hbase17:34091] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 13:38:10,445 INFO [RS:2;jenkins-hbase17:35445] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 13:38:10,445 DEBUG [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 13:38:10,445 DEBUG [RS:0;jenkins-hbase17:39081] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 13:38:10,445 DEBUG [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 13:38:10,448 INFO [RS:0;jenkins-hbase17:39081] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,42137,1689169087924 with isa=jenkins-hbase17.apache.org/136.243.18.41:39081, startcode=1689169089182 2023-07-12 13:38:10,448 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,42137,1689169087924 with isa=jenkins-hbase17.apache.org/136.243.18.41:34091, startcode=1689169089223 2023-07-12 13:38:10,448 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,42137,1689169087924 with isa=jenkins-hbase17.apache.org/136.243.18.41:35445, startcode=1689169089256 2023-07-12 13:38:10,454 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 13:38:10,454 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 13:38:10,454 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 13:38:10,455 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 13:38:10,455 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-12 13:38:10,455 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,455 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-12 13:38:10,455 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,456 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689169120456 2023-07-12 13:38:10,458 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 13:38:10,464 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 13:38:10,465 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 13:38:10,469 DEBUG [RS:1;jenkins-hbase17:34091] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 13:38:10,469 DEBUG [RS:2;jenkins-hbase17:35445] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 13:38:10,469 DEBUG [RS:0;jenkins-hbase17:39081] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 13:38:10,471 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 13:38:10,472 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 13:38:10,480 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 13:38:10,480 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 13:38:10,480 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 13:38:10,480 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 13:38:10,484 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,485 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 13:38:10,486 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 13:38:10,487 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 13:38:10,489 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 13:38:10,489 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 13:38:10,492 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689169090491,5,FailOnTimeoutGroup] 2023-07-12 13:38:10,493 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689169090492,5,FailOnTimeoutGroup] 2023-07-12 13:38:10,493 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,493 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 13:38:10,495 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,495 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,561 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 13:38:10,561 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36157, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 13:38:10,561 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58319, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 13:38:10,561 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44699, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 13:38:10,563 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 13:38:10,563 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9 2023-07-12 13:38:10,581 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42137] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:10,592 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:10,595 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 13:38:10,598 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42137] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:10,599 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42137] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:10,601 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/info 2023-07-12 13:38:10,601 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 13:38:10,603 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:10,603 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 13:38:10,604 DEBUG [RS:0;jenkins-hbase17:39081] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9 2023-07-12 13:38:10,604 DEBUG [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9 2023-07-12 13:38:10,605 DEBUG [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:43791 2023-07-12 13:38:10,604 DEBUG [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9 2023-07-12 13:38:10,605 DEBUG [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:43791 2023-07-12 13:38:10,605 DEBUG [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 13:38:10,605 DEBUG [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 13:38:10,605 DEBUG [RS:0;jenkins-hbase17:39081] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:43791 2023-07-12 13:38:10,605 DEBUG [RS:0;jenkins-hbase17:39081] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 13:38:10,607 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/rep_barrier 2023-07-12 13:38:10,608 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 13:38:10,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:10,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 13:38:10,612 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:38:10,613 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/table 2023-07-12 13:38:10,613 DEBUG [RS:2;jenkins-hbase17:35445] zookeeper.ZKUtil(162): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:10,613 DEBUG [RS:0;jenkins-hbase17:39081] zookeeper.ZKUtil(162): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:10,613 WARN [RS:2;jenkins-hbase17:35445] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 13:38:10,613 DEBUG [RS:1;jenkins-hbase17:34091] zookeeper.ZKUtil(162): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:10,614 WARN [RS:0;jenkins-hbase17:39081] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 13:38:10,614 WARN [RS:1;jenkins-hbase17:34091] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 13:38:10,614 INFO [RS:2;jenkins-hbase17:35445] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 13:38:10,615 INFO [RS:1;jenkins-hbase17:34091] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 13:38:10,615 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 13:38:10,614 INFO [RS:0;jenkins-hbase17:39081] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 13:38:10,615 DEBUG [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:10,615 DEBUG [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:10,616 DEBUG [RS:0;jenkins-hbase17:39081] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:10,616 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,35445,1689169089256] 2023-07-12 13:38:10,616 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,39081,1689169089182] 2023-07-12 13:38:10,616 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,34091,1689169089223] 2023-07-12 13:38:10,616 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:10,620 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740 2023-07-12 13:38:10,622 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740 2023-07-12 13:38:10,628 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:10,628 DEBUG [RS:1;jenkins-hbase17:34091] zookeeper.ZKUtil(162): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:10,629 DEBUG [RS:2;jenkins-hbase17:35445] zookeeper.ZKUtil(162): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:10,629 DEBUG [RS:1;jenkins-hbase17:34091] zookeeper.ZKUtil(162): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:10,629 DEBUG [RS:2;jenkins-hbase17:35445] zookeeper.ZKUtil(162): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:10,629 DEBUG [RS:0;jenkins-hbase17:39081] zookeeper.ZKUtil(162): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:10,630 DEBUG [RS:2;jenkins-hbase17:35445] zookeeper.ZKUtil(162): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:10,630 DEBUG [RS:1;jenkins-hbase17:34091] zookeeper.ZKUtil(162): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:10,630 DEBUG [RS:0;jenkins-hbase17:39081] zookeeper.ZKUtil(162): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:10,631 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 13:38:10,631 DEBUG [RS:0;jenkins-hbase17:39081] zookeeper.ZKUtil(162): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:10,634 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:10,635 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74041204, jitterRate=0.10329991579055786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:10,635 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 13:38:10,635 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 13:38:10,635 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 13:38:10,635 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 13:38:10,636 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 13:38:10,636 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 13:38:10,637 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 13:38:10,637 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 13:38:10,642 DEBUG [RS:1;jenkins-hbase17:34091] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 13:38:10,642 DEBUG [RS:0;jenkins-hbase17:39081] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 13:38:10,642 DEBUG [RS:2;jenkins-hbase17:35445] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 13:38:10,643 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 13:38:10,643 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 13:38:10,651 INFO [RS:1;jenkins-hbase17:34091] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 13:38:10,651 INFO [RS:0;jenkins-hbase17:39081] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 13:38:10,651 INFO [RS:2;jenkins-hbase17:35445] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 13:38:10,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 13:38:10,670 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 13:38:10,672 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 13:38:10,678 INFO [RS:1;jenkins-hbase17:34091] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 13:38:10,678 INFO [RS:2;jenkins-hbase17:35445] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 13:38:10,678 INFO [RS:0;jenkins-hbase17:39081] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 13:38:10,682 INFO [RS:1;jenkins-hbase17:34091] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:38:10,682 INFO [RS:0;jenkins-hbase17:39081] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:38:10,682 INFO [RS:1;jenkins-hbase17:34091] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,682 INFO [RS:0;jenkins-hbase17:39081] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,682 INFO [RS:2;jenkins-hbase17:35445] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 13:38:10,683 INFO [RS:2;jenkins-hbase17:35445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,683 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 13:38:10,683 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 13:38:10,683 INFO [RS:0;jenkins-hbase17:39081] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 13:38:10,691 INFO [RS:2;jenkins-hbase17:35445] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,691 INFO [RS:0;jenkins-hbase17:39081] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,691 INFO [RS:1;jenkins-hbase17:34091] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,691 DEBUG [RS:2;jenkins-hbase17:35445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,691 DEBUG [RS:0;jenkins-hbase17:39081] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,692 DEBUG [RS:2;jenkins-hbase17:35445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,692 DEBUG [RS:0;jenkins-hbase17:39081] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,692 DEBUG [RS:1;jenkins-hbase17:34091] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,692 DEBUG [RS:0;jenkins-hbase17:39081] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,692 DEBUG [RS:1;jenkins-hbase17:34091] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,692 DEBUG [RS:0;jenkins-hbase17:39081] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,692 DEBUG [RS:1;jenkins-hbase17:34091] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,692 DEBUG [RS:0;jenkins-hbase17:39081] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,692 DEBUG [RS:1;jenkins-hbase17:34091] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,693 DEBUG [RS:0;jenkins-hbase17:39081] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-12 13:38:10,693 DEBUG [RS:1;jenkins-hbase17:34091] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,693 DEBUG [RS:0;jenkins-hbase17:39081] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,693 DEBUG [RS:1;jenkins-hbase17:34091] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-12 13:38:10,693 DEBUG [RS:0;jenkins-hbase17:39081] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,693 DEBUG [RS:1;jenkins-hbase17:34091] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,693 DEBUG [RS:0;jenkins-hbase17:39081] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,693 DEBUG [RS:1;jenkins-hbase17:34091] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,693 DEBUG [RS:0;jenkins-hbase17:39081] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,693 DEBUG [RS:1;jenkins-hbase17:34091] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,692 DEBUG [RS:2;jenkins-hbase17:35445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,693 DEBUG [RS:1;jenkins-hbase17:34091] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,694 DEBUG [RS:2;jenkins-hbase17:35445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,694 DEBUG [RS:2;jenkins-hbase17:35445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,694 INFO [RS:0;jenkins-hbase17:39081] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,694 DEBUG [RS:2;jenkins-hbase17:35445] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-12 13:38:10,695 INFO [RS:0;jenkins-hbase17:39081] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,695 INFO [RS:1;jenkins-hbase17:34091] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,695 INFO [RS:0;jenkins-hbase17:39081] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,695 INFO [RS:1;jenkins-hbase17:34091] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,695 DEBUG [RS:2;jenkins-hbase17:35445] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,695 INFO [RS:1;jenkins-hbase17:34091] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,695 DEBUG [RS:2;jenkins-hbase17:35445] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,695 DEBUG [RS:2;jenkins-hbase17:35445] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,695 DEBUG [RS:2;jenkins-hbase17:35445] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 13:38:10,699 INFO [RS:2;jenkins-hbase17:35445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,699 INFO [RS:2;jenkins-hbase17:35445] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,699 INFO [RS:2;jenkins-hbase17:35445] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,712 INFO [RS:0;jenkins-hbase17:39081] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 13:38:10,712 INFO [RS:2;jenkins-hbase17:35445] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 13:38:10,713 INFO [RS:1;jenkins-hbase17:34091] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 13:38:10,714 INFO [RS:2;jenkins-hbase17:35445] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35445,1689169089256-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,714 INFO [RS:0;jenkins-hbase17:39081] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,39081,1689169089182-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,714 INFO [RS:1;jenkins-hbase17:34091] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,34091,1689169089223-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:10,729 INFO [RS:2;jenkins-hbase17:35445] regionserver.Replication(203): jenkins-hbase17.apache.org,35445,1689169089256 started 2023-07-12 13:38:10,729 INFO [RS:0;jenkins-hbase17:39081] regionserver.Replication(203): jenkins-hbase17.apache.org,39081,1689169089182 started 2023-07-12 13:38:10,729 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,35445,1689169089256, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:35445, sessionid=0x10159c043900003 2023-07-12 13:38:10,729 INFO [RS:0;jenkins-hbase17:39081] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,39081,1689169089182, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:39081, sessionid=0x10159c043900001 2023-07-12 13:38:10,729 DEBUG [RS:0;jenkins-hbase17:39081] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 13:38:10,729 DEBUG [RS:2;jenkins-hbase17:35445] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 13:38:10,730 DEBUG [RS:0;jenkins-hbase17:39081] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:10,730 DEBUG [RS:2;jenkins-hbase17:35445] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:10,730 DEBUG [RS:0;jenkins-hbase17:39081] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,39081,1689169089182' 2023-07-12 13:38:10,730 DEBUG [RS:2;jenkins-hbase17:35445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35445,1689169089256' 2023-07-12 13:38:10,731 DEBUG [RS:2;jenkins-hbase17:35445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:38:10,731 DEBUG [RS:0;jenkins-hbase17:39081] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:38:10,731 DEBUG [RS:0;jenkins-hbase17:39081] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:38:10,731 DEBUG [RS:2;jenkins-hbase17:35445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:38:10,732 DEBUG [RS:0;jenkins-hbase17:39081] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 13:38:10,732 DEBUG [RS:2;jenkins-hbase17:35445] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 13:38:10,732 DEBUG [RS:0;jenkins-hbase17:39081] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 13:38:10,732 DEBUG [RS:2;jenkins-hbase17:35445] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 13:38:10,732 DEBUG [RS:0;jenkins-hbase17:39081] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:10,732 DEBUG [RS:2;jenkins-hbase17:35445] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:10,732 DEBUG [RS:0;jenkins-hbase17:39081] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,39081,1689169089182' 2023-07-12 13:38:10,733 DEBUG [RS:0;jenkins-hbase17:39081] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 13:38:10,733 DEBUG [RS:2;jenkins-hbase17:35445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35445,1689169089256' 2023-07-12 13:38:10,733 DEBUG [RS:2;jenkins-hbase17:35445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 13:38:10,733 DEBUG [RS:0;jenkins-hbase17:39081] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 13:38:10,733 DEBUG [RS:2;jenkins-hbase17:35445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 13:38:10,734 DEBUG [RS:0;jenkins-hbase17:39081] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 13:38:10,734 DEBUG [RS:2;jenkins-hbase17:35445] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 13:38:10,734 INFO [RS:0;jenkins-hbase17:39081] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 13:38:10,734 INFO [RS:0;jenkins-hbase17:39081] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 13:38:10,734 INFO [RS:2;jenkins-hbase17:35445] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 13:38:10,739 INFO [RS:1;jenkins-hbase17:34091] regionserver.Replication(203): jenkins-hbase17.apache.org,34091,1689169089223 started 2023-07-12 13:38:10,739 INFO [RS:2;jenkins-hbase17:35445] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 13:38:10,739 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,34091,1689169089223, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:34091, sessionid=0x10159c043900002 2023-07-12 13:38:10,739 DEBUG [RS:1;jenkins-hbase17:34091] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 13:38:10,739 DEBUG [RS:1;jenkins-hbase17:34091] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:10,739 DEBUG [RS:1;jenkins-hbase17:34091] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,34091,1689169089223' 2023-07-12 13:38:10,740 DEBUG [RS:1;jenkins-hbase17:34091] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 13:38:10,740 DEBUG [RS:1;jenkins-hbase17:34091] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 13:38:10,741 DEBUG [RS:1;jenkins-hbase17:34091] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 13:38:10,741 DEBUG [RS:1;jenkins-hbase17:34091] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 13:38:10,741 DEBUG [RS:1;jenkins-hbase17:34091] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:10,741 DEBUG [RS:1;jenkins-hbase17:34091] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,34091,1689169089223' 2023-07-12 13:38:10,741 DEBUG [RS:1;jenkins-hbase17:34091] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 13:38:10,742 DEBUG [RS:1;jenkins-hbase17:34091] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 13:38:10,742 DEBUG [RS:1;jenkins-hbase17:34091] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 13:38:10,742 INFO [RS:1;jenkins-hbase17:34091] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 13:38:10,742 INFO [RS:1;jenkins-hbase17:34091] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 13:38:10,826 DEBUG [jenkins-hbase17:42137] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 13:38:10,833 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 13:38:10,838 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 13:38:10,838 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 13:38:10,839 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 13:38:10,839 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 13:38:10,841 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,39081,1689169089182, state=OPENING 2023-07-12 13:38:10,845 INFO [RS:1;jenkins-hbase17:34091] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C34091%2C1689169089223, suffix=, logDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,34091,1689169089223, archiveDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/oldWALs, maxLogs=32 2023-07-12 13:38:10,845 INFO [RS:0;jenkins-hbase17:39081] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C39081%2C1689169089182, suffix=, logDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182, archiveDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/oldWALs, maxLogs=32 2023-07-12 13:38:10,845 INFO [RS:2;jenkins-hbase17:35445] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35445%2C1689169089256, suffix=, logDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,35445,1689169089256, archiveDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/oldWALs, maxLogs=32 2023-07-12 13:38:10,851 DEBUG [PEWorker-1] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 13:38:10,852 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:38:10,854 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 13:38:10,856 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,39081,1689169089182}] 2023-07-12 13:38:10,871 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK] 2023-07-12 13:38:10,873 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK] 2023-07-12 13:38:10,873 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK] 2023-07-12 13:38:10,886 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK] 2023-07-12 13:38:10,886 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK] 2023-07-12 13:38:10,887 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK] 2023-07-12 13:38:10,890 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK] 2023-07-12 13:38:10,890 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK] 2023-07-12 13:38:10,890 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK] 2023-07-12 13:38:10,902 INFO [RS:1;jenkins-hbase17:34091] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,34091,1689169089223/jenkins-hbase17.apache.org%2C34091%2C1689169089223.1689169090851 2023-07-12 13:38:10,902 INFO [RS:2;jenkins-hbase17:35445] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,35445,1689169089256/jenkins-hbase17.apache.org%2C35445%2C1689169089256.1689169090851 2023-07-12 13:38:10,902 INFO [RS:0;jenkins-hbase17:39081] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851 2023-07-12 13:38:10,902 DEBUG [RS:1;jenkins-hbase17:34091] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK], DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK], DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK]] 2023-07-12 13:38:10,903 DEBUG [RS:0;jenkins-hbase17:39081] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK], DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK], DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK]] 2023-07-12 13:38:10,906 DEBUG [RS:2;jenkins-hbase17:35445] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK], DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK], DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK]] 2023-07-12 13:38:11,072 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:11,074 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 13:38:11,078 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 13:38:11,093 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 13:38:11,094 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 13:38:11,098 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182, archiveDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/oldWALs, maxLogs=32 2023-07-12 13:38:11,146 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK] 2023-07-12 13:38:11,147 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK] 2023-07-12 13:38:11,146 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK] 2023-07-12 13:38:11,152 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta 2023-07-12 13:38:11,153 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK], DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK], DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK]] 2023-07-12 13:38:11,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:38:11,156 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 13:38:11,174 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 13:38:11,179 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 13:38:11,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 13:38:11,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:11,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 13:38:11,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 13:38:11,187 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 13:38:11,189 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/info 2023-07-12 13:38:11,189 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/info 2023-07-12 13:38:11,190 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 13:38:11,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:11,191 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 13:38:11,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/rep_barrier 2023-07-12 13:38:11,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/rep_barrier 2023-07-12 13:38:11,193 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 13:38:11,194 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:11,194 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 13:38:11,196 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/table 2023-07-12 13:38:11,196 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/table 2023-07-12 13:38:11,196 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 13:38:11,197 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:11,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740 2023-07-12 13:38:11,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740 2023-07-12 13:38:11,208 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:11,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 13:38:11,212 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58936452, jitterRate=-0.12177842855453491}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:11,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 13:38:11,224 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689169091064 2023-07-12 13:38:11,249 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 13:38:11,250 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 13:38:11,251 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,39081,1689169089182, state=OPEN 2023-07-12 13:38:11,292 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 13:38:11,293 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 13:38:11,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 13:38:11,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,39081,1689169089182 in 437 msec 2023-07-12 13:38:11,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 13:38:11,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 649 msec 2023-07-12 13:38:11,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 949 msec 2023-07-12 13:38:11,311 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689169091311, completionTime=-1 2023-07-12 13:38:11,311 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 13:38:11,311 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 13:38:11,377 DEBUG [hconnection-0x639efd03-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:38:11,380 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:38:11,394 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 13:38:11,394 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689169151394 2023-07-12 13:38:11,394 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689169211394 2023-07-12 13:38:11,394 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 82 msec 2023-07-12 13:38:11,417 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,42137,1689169087924-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:11,417 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,42137,1689169087924-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:11,417 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,42137,1689169087924-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:11,418 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:42137, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:11,419 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 13:38:11,425 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 13:38:11,432 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 13:38:11,434 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 13:38:11,444 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 13:38:11,447 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:38:11,449 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:38:11,473 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856 2023-07-12 13:38:11,475 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856 empty. 2023-07-12 13:38:11,476 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856 2023-07-12 13:38:11,476 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 13:38:11,516 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 13:38:11,518 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e303901740e4d02964c49fa9d2b7f856, NAME => 'hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:11,536 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:11,536 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e303901740e4d02964c49fa9d2b7f856, disabling compactions & flushes 2023-07-12 13:38:11,536 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:38:11,536 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:38:11,536 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. after waiting 0 ms 2023-07-12 13:38:11,536 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:38:11,536 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:38:11,536 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e303901740e4d02964c49fa9d2b7f856: 2023-07-12 13:38:11,543 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:38:11,556 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689169091545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169091545"}]},"ts":"1689169091545"} 2023-07-12 13:38:11,583 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 13:38:11,585 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:38:11,590 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689169091586"}]},"ts":"1689169091586"} 2023-07-12 13:38:11,595 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 13:38:11,598 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 13:38:11,599 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 13:38:11,600 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 13:38:11,600 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 13:38:11,600 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 13:38:11,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e303901740e4d02964c49fa9d2b7f856, ASSIGN}] 2023-07-12 13:38:11,606 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e303901740e4d02964c49fa9d2b7f856, ASSIGN 2023-07-12 13:38:11,607 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e303901740e4d02964c49fa9d2b7f856, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35445,1689169089256; forceNewPlan=false, retain=false 2023-07-12 13:38:11,759 INFO [jenkins-hbase17:42137] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 13:38:11,760 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e303901740e4d02964c49fa9d2b7f856, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:11,761 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689169091760"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169091760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169091760"}]},"ts":"1689169091760"} 2023-07-12 13:38:11,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e303901740e4d02964c49fa9d2b7f856, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:38:11,920 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:11,920 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 13:38:11,924 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 13:38:11,933 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:38:11,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e303901740e4d02964c49fa9d2b7f856, NAME => 'hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856.', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:38:11,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e303901740e4d02964c49fa9d2b7f856 2023-07-12 13:38:11,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:11,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e303901740e4d02964c49fa9d2b7f856 2023-07-12 13:38:11,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e303901740e4d02964c49fa9d2b7f856 2023-07-12 13:38:11,936 INFO [StoreOpener-e303901740e4d02964c49fa9d2b7f856-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e303901740e4d02964c49fa9d2b7f856 2023-07-12 13:38:11,939 DEBUG [StoreOpener-e303901740e4d02964c49fa9d2b7f856-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856/info 2023-07-12 13:38:11,939 DEBUG [StoreOpener-e303901740e4d02964c49fa9d2b7f856-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856/info 2023-07-12 13:38:11,940 INFO [StoreOpener-e303901740e4d02964c49fa9d2b7f856-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e303901740e4d02964c49fa9d2b7f856 columnFamilyName info 2023-07-12 13:38:11,941 INFO [StoreOpener-e303901740e4d02964c49fa9d2b7f856-1] regionserver.HStore(310): Store=e303901740e4d02964c49fa9d2b7f856/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:11,943 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856 2023-07-12 13:38:11,944 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856 2023-07-12 13:38:11,950 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e303901740e4d02964c49fa9d2b7f856 2023-07-12 13:38:11,954 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:11,955 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e303901740e4d02964c49fa9d2b7f856; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60657409, jitterRate=-0.09613417088985443}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 13:38:11,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e303901740e4d02964c49fa9d2b7f856: 2023-07-12 13:38:11,958 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856., pid=6, masterSystemTime=1689169091920 2023-07-12 13:38:11,965 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:38:11,966 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:38:11,968 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e303901740e4d02964c49fa9d2b7f856, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:11,968 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689169091967"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169091967"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169091967"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169091967"}]},"ts":"1689169091967"} 2023-07-12 13:38:11,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 13:38:11,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e303901740e4d02964c49fa9d2b7f856, server=jenkins-hbase17.apache.org,35445,1689169089256 in 208 msec 2023-07-12 13:38:11,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 13:38:11,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e303901740e4d02964c49fa9d2b7f856, ASSIGN in 379 msec 2023-07-12 13:38:11,990 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:38:11,990 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689169091990"}]},"ts":"1689169091990"} 2023-07-12 13:38:11,993 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 13:38:11,996 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:38:12,000 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 562 msec 2023-07-12 13:38:12,047 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 13:38:12,048 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 13:38:12,048 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:38:12,071 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:38:12,073 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:38:12,090 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 13:38:12,115 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 13:38:12,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 41 msec 2023-07-12 13:38:12,134 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 13:38:12,145 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 13:38:12,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-07-12 13:38:12,159 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 13:38:12,161 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 13:38:12,161 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.851sec 2023-07-12 13:38:12,165 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 13:38:12,166 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 13:38:12,166 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 13:38:12,168 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,42137,1689169087924-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 13:38:12,168 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,42137,1689169087924-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 13:38:12,177 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 13:38:12,189 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ReadOnlyZKClient(139): Connect 0x01ae8a1e to 127.0.0.1:56143 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 13:38:12,194 DEBUG [Listener at localhost.localdomain/40361] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@445a58a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 13:38:12,214 DEBUG [hconnection-0x5b9b07b5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:38:12,228 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:38:12,236 INFO [Listener at localhost.localdomain/40361] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,42137,1689169087924 2023-07-12 13:38:12,238 WARN [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-12 13:38:12,251 DEBUG [Listener at localhost.localdomain/40361] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 13:38:12,255 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:38:12,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 13:38:12,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 13:38:12,277 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 13:38:12,281 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 13:38:12,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true" procId is: 9 2023-07-12 13:38:12,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:38:12,311 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:38:12,311 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909 2023-07-12 13:38:12,311 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310 2023-07-12 13:38:12,311 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4 2023-07-12 13:38:12,311 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:38:12,311 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:38:12,311 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:38:12,311 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:38:12,312 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a empty. 2023-07-12 13:38:12,312 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4 empty. 2023-07-12 13:38:12,312 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310 empty. 2023-07-12 13:38:12,312 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909 empty. 2023-07-12 13:38:12,312 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8 empty. 2023-07-12 13:38:12,312 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c empty. 2023-07-12 13:38:12,318 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5 empty. 2023-07-12 13:38:12,318 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4 2023-07-12 13:38:12,318 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:38:12,318 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:38:12,318 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:38:12,318 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd empty. 2023-07-12 13:38:12,318 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:38:12,318 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:38:12,318 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:38:12,319 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:38:12,319 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909 2023-07-12 13:38:12,319 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:38:12,319 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:38:12,319 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8 empty. 2023-07-12 13:38:12,319 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:38:12,319 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc empty. 2023-07-12 13:38:12,319 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310 2023-07-12 13:38:12,319 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:38:12,319 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d empty. 2023-07-12 13:38:12,319 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80 empty. 2023-07-12 13:38:12,321 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:38:12,321 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:38:12,322 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:38:12,322 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:38:12,322 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:38:12,322 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8 empty. 2023-07-12 13:38:12,322 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:38:12,322 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:38:12,322 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963 2023-07-12 13:38:12,322 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7 empty. 2023-07-12 13:38:12,322 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:38:12,322 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:38:12,323 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672 empty. 2023-07-12 13:38:12,323 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da empty. 2023-07-12 13:38:12,323 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:38:12,323 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:38:12,323 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381 empty. 2023-07-12 13:38:12,323 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963 empty. 2023-07-12 13:38:12,323 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:38:12,323 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:38:12,324 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:38:12,324 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:38:12,324 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5 2023-07-12 13:38:12,324 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d 2023-07-12 13:38:12,324 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963 2023-07-12 13:38:12,324 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:38:12,324 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38 empty. 2023-07-12 13:38:12,325 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1 empty. 2023-07-12 13:38:12,325 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:38:12,325 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:38:12,325 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5 empty. 2023-07-12 13:38:12,325 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8 empty. 2023-07-12 13:38:12,325 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a empty. 2023-07-12 13:38:12,325 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:38:12,326 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d empty. 2023-07-12 13:38:12,326 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:38:12,327 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d empty. 2023-07-12 13:38:12,328 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:38:12,328 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d 2023-07-12 13:38:12,328 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468 empty. 2023-07-12 13:38:12,328 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:38:12,329 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:38:12,329 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5 2023-07-12 13:38:12,329 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:38:12,329 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true regions 2023-07-12 13:38:12,351 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/.tabledesc/.tableinfo.0000000001 2023-07-12 13:38:12,353 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 5140a4a30c94e149363cee692772d310, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310.', STARTKEY => 'ccc', ENDKEY => 'ddd'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,353 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 216faae9d032640dca24ddf65ab9f909, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909.', STARTKEY => 'bbb', ENDKEY => 'ccc'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,353 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec05a52723edbecd7be77f36806caa8a, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a.', STARTKEY => '', ENDKEY => 'bbb'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:38:12,403 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,404 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 5140a4a30c94e149363cee692772d310, disabling compactions & flushes 2023-07-12 13:38:12,404 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:38:12,404 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:38:12,404 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. after waiting 0 ms 2023-07-12 13:38:12,404 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:38:12,404 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:38:12,404 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 5140a4a30c94e149363cee692772d310: 2023-07-12 13:38:12,405 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 221aa1ce383e614c344b914ded3151c4, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4.', STARTKEY => 'ddd', ENDKEY => 'eee'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,409 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,409 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 216faae9d032640dca24ddf65ab9f909, disabling compactions & flushes 2023-07-12 13:38:12,410 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:38:12,410 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:38:12,410 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. after waiting 0 ms 2023-07-12 13:38:12,410 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:38:12,410 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:38:12,410 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 216faae9d032640dca24ddf65ab9f909: 2023-07-12 13:38:12,410 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,413 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing ec05a52723edbecd7be77f36806caa8a, disabling compactions & flushes 2023-07-12 13:38:12,413 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:38:12,413 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:38:12,413 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. after waiting 0 ms 2023-07-12 13:38:12,413 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:38:12,413 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:38:12,413 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => e3b643504d1d8a33902c66ba6c8a69fd, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd.', STARTKEY => 'eee', ENDKEY => 'fff'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,413 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for ec05a52723edbecd7be77f36806caa8a: 2023-07-12 13:38:12,416 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 555ad7ad110af9ec101b9dfc5a07fa5c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c.', STARTKEY => 'fff', ENDKEY => 'ggg'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,481 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,483 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 221aa1ce383e614c344b914ded3151c4, disabling compactions & flushes 2023-07-12 13:38:12,483 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:38:12,483 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:38:12,483 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. after waiting 0 ms 2023-07-12 13:38:12,484 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:38:12,484 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:38:12,484 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 221aa1ce383e614c344b914ded3151c4: 2023-07-12 13:38:12,487 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 92478ee2b34576368e173be7ee67f2a5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5.', STARTKEY => 'ggg', ENDKEY => 'hhh'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,490 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,491 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 555ad7ad110af9ec101b9dfc5a07fa5c, disabling compactions & flushes 2023-07-12 13:38:12,491 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:38:12,491 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:38:12,491 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. after waiting 0 ms 2023-07-12 13:38:12,491 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:38:12,492 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:38:12,492 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 555ad7ad110af9ec101b9dfc5a07fa5c: 2023-07-12 13:38:12,493 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 260e260b05fbc83a4eb4ced4fbf3a9d8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8.', STARTKEY => 'hhh', ENDKEY => 'iii'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,495 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,496 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing e3b643504d1d8a33902c66ba6c8a69fd, disabling compactions & flushes 2023-07-12 13:38:12,496 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:38:12,496 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:38:12,496 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. after waiting 0 ms 2023-07-12 13:38:12,496 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:38:12,496 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:38:12,496 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for e3b643504d1d8a33902c66ba6c8a69fd: 2023-07-12 13:38:12,497 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 912c554550dbcecd943b5e17bf1b23fc, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc.', STARTKEY => 'iii', ENDKEY => 'jjj'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,516 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,517 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 92478ee2b34576368e173be7ee67f2a5, disabling compactions & flushes 2023-07-12 13:38:12,517 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:38:12,517 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:38:12,517 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. after waiting 0 ms 2023-07-12 13:38:12,517 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:38:12,517 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:38:12,517 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 92478ee2b34576368e173be7ee67f2a5: 2023-07-12 13:38:12,519 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 0bad15f8b77a93491f41e70639dc1fc8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8.', STARTKEY => 'jjj', ENDKEY => 'kkk'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,533 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,534 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 912c554550dbcecd943b5e17bf1b23fc, disabling compactions & flushes 2023-07-12 13:38:12,534 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:38:12,534 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:38:12,534 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. after waiting 0 ms 2023-07-12 13:38:12,534 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:38:12,534 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:38:12,534 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 912c554550dbcecd943b5e17bf1b23fc: 2023-07-12 13:38:12,535 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => fd43ad19523fd1e39bad44724f1ef3da, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da.', STARTKEY => 'kkk', ENDKEY => 'lll'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,535 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,536 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 260e260b05fbc83a4eb4ced4fbf3a9d8, disabling compactions & flushes 2023-07-12 13:38:12,536 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:38:12,536 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:38:12,536 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. after waiting 0 ms 2023-07-12 13:38:12,536 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:38:12,537 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:38:12,537 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 260e260b05fbc83a4eb4ced4fbf3a9d8: 2023-07-12 13:38:12,538 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => f9e1981fea95432fc8fb92eb7cc4524d, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d.', STARTKEY => 'lll', ENDKEY => 'mmm'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,556 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,557 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 0bad15f8b77a93491f41e70639dc1fc8, disabling compactions & flushes 2023-07-12 13:38:12,557 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:38:12,557 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:38:12,557 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. after waiting 0 ms 2023-07-12 13:38:12,557 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:38:12,557 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:38:12,557 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 0bad15f8b77a93491f41e70639dc1fc8: 2023-07-12 13:38:12,558 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 674f5b2fb0eacd68f031d75fb1103b80, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80.', STARTKEY => 'mmm', ENDKEY => 'nnn'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,573 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,573 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,574 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing f9e1981fea95432fc8fb92eb7cc4524d, disabling compactions & flushes 2023-07-12 13:38:12,575 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing fd43ad19523fd1e39bad44724f1ef3da, disabling compactions & flushes 2023-07-12 13:38:12,575 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:38:12,575 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:38:12,575 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:38:12,575 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:38:12,575 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. after waiting 0 ms 2023-07-12 13:38:12,575 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. after waiting 0 ms 2023-07-12 13:38:12,575 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:38:12,575 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:38:12,575 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:38:12,575 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:38:12,575 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for f9e1981fea95432fc8fb92eb7cc4524d: 2023-07-12 13:38:12,575 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for fd43ad19523fd1e39bad44724f1ef3da: 2023-07-12 13:38:12,576 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => fa76a2771db04ba3b6a7d1be4a08daf8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8.', STARTKEY => 'ooo', ENDKEY => 'ppp'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,577 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4d1dc6d5e0bd7eff97daa4fe943dbce7, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7.', STARTKEY => 'nnn', ENDKEY => 'ooo'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,591 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,593 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 674f5b2fb0eacd68f031d75fb1103b80, disabling compactions & flushes 2023-07-12 13:38:12,593 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:38:12,593 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:38:12,593 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. after waiting 0 ms 2023-07-12 13:38:12,593 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:38:12,593 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:38:12,593 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 674f5b2fb0eacd68f031d75fb1103b80: 2023-07-12 13:38:12,593 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => b38842d7461fd90c4f30b3afd99f11b8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8.', STARTKEY => 'ppp', ENDKEY => 'qqq'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:38:12,612 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,613 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing fa76a2771db04ba3b6a7d1be4a08daf8, disabling compactions & flushes 2023-07-12 13:38:12,613 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:38:12,613 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:38:12,613 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. after waiting 0 ms 2023-07-12 13:38:12,613 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:38:12,613 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:38:12,613 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for fa76a2771db04ba3b6a7d1be4a08daf8: 2023-07-12 13:38:12,614 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4641e91601e8baa52f8f326a3d617a38, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38.', STARTKEY => 'qqq', ENDKEY => 'rrr'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,616 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,616 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing b38842d7461fd90c4f30b3afd99f11b8, disabling compactions & flushes 2023-07-12 13:38:12,616 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:38:12,616 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:38:12,616 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. after waiting 0 ms 2023-07-12 13:38:12,616 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:38:12,616 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:38:12,616 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for b38842d7461fd90c4f30b3afd99f11b8: 2023-07-12 13:38:12,617 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => a623158b89e27dff4b3c43e771d2b672, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672.', STARTKEY => 'rrr', ENDKEY => 'sss'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,632 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,633 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 4641e91601e8baa52f8f326a3d617a38, disabling compactions & flushes 2023-07-12 13:38:12,634 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:38:12,634 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:38:12,634 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. after waiting 0 ms 2023-07-12 13:38:12,634 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:38:12,634 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:38:12,635 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 4641e91601e8baa52f8f326a3d617a38: 2023-07-12 13:38:12,635 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5c50497f7f74f39b808201e941fd8963, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963.', STARTKEY => 'sss', ENDKEY => 'ttt'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,638 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,638 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing a623158b89e27dff4b3c43e771d2b672, disabling compactions & flushes 2023-07-12 13:38:12,639 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:38:12,639 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:38:12,639 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. after waiting 0 ms 2023-07-12 13:38:12,639 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:38:12,639 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:38:12,639 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for a623158b89e27dff4b3c43e771d2b672: 2023-07-12 13:38:12,639 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 20ad56ffb65cb5bab6d1f89dc701d381, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381.', STARTKEY => 'ttt', ENDKEY => 'uuu'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,654 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,654 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 5c50497f7f74f39b808201e941fd8963, disabling compactions & flushes 2023-07-12 13:38:12,655 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:38:12,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:38:12,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. after waiting 0 ms 2023-07-12 13:38:12,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:38:12,655 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:38:12,655 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 5c50497f7f74f39b808201e941fd8963: 2023-07-12 13:38:12,655 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 06b18c3992cc931e8054a4dcc480ece1, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1.', STARTKEY => 'uuu', ENDKEY => 'vvv'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,669 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,670 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 06b18c3992cc931e8054a4dcc480ece1, disabling compactions & flushes 2023-07-12 13:38:12,670 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:38:12,670 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:38:12,670 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. after waiting 0 ms 2023-07-12 13:38:12,670 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:38:12,670 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:38:12,670 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 06b18c3992cc931e8054a4dcc480ece1: 2023-07-12 13:38:12,670 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6deb0a5007b6ff006e3a4a9f7e3b5f3d, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d.', STARTKEY => 'vvv', ENDKEY => 'www'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,686 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,687 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 6deb0a5007b6ff006e3a4a9f7e3b5f3d, disabling compactions & flushes 2023-07-12 13:38:12,687 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:38:12,687 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:38:12,687 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. after waiting 0 ms 2023-07-12 13:38:12,687 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:38:12,687 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:38:12,687 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 6deb0a5007b6ff006e3a4a9f7e3b5f3d: 2023-07-12 13:38:12,687 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => c4e74d3136130f438093e2507612b0b5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5.', STARTKEY => 'www', ENDKEY => 'xxx'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,702 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,702 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing c4e74d3136130f438093e2507612b0b5, disabling compactions & flushes 2023-07-12 13:38:12,702 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:38:12,702 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:38:12,702 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. after waiting 0 ms 2023-07-12 13:38:12,702 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:38:12,702 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:38:12,702 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for c4e74d3136130f438093e2507612b0b5: 2023-07-12 13:38:12,702 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 736207afd3173343fa3290362bfa994d, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d.', STARTKEY => 'xxx', ENDKEY => 'yyy'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,718 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,718 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 736207afd3173343fa3290362bfa994d, disabling compactions & flushes 2023-07-12 13:38:12,718 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:38:12,718 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:38:12,718 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. after waiting 0 ms 2023-07-12 13:38:12,718 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:38:12,718 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:38:12,719 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 736207afd3173343fa3290362bfa994d: 2023-07-12 13:38:12,719 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 98e8c1a65ac96e53d5bdaf4943cf497a, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a.', STARTKEY => 'yyy', ENDKEY => 'zzz'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,733 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,733 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 98e8c1a65ac96e53d5bdaf4943cf497a, disabling compactions & flushes 2023-07-12 13:38:12,733 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:38:12,734 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:38:12,734 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. after waiting 0 ms 2023-07-12 13:38:12,734 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:38:12,734 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:38:12,734 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 98e8c1a65ac96e53d5bdaf4943cf497a: 2023-07-12 13:38:12,734 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 19ef6586ee290d893dc86ad8b10dd468, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468.', STARTKEY => 'zzz', ENDKEY => ''}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/.tmp 2023-07-12 13:38:12,771 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:12,771 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 19ef6586ee290d893dc86ad8b10dd468, disabling compactions & flushes 2023-07-12 13:38:12,771 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:38:12,771 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:38:12,771 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. after waiting 0 ms 2023-07-12 13:38:12,771 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:38:12,771 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:38:12,772 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 19ef6586ee290d893dc86ad8b10dd468: 2023-07-12 13:38:12,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:38:13,012 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,013 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 4d1dc6d5e0bd7eff97daa4fe943dbce7, disabling compactions & flushes 2023-07-12 13:38:13,013 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:38:13,013 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:38:13,013 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. after waiting 0 ms 2023-07-12 13:38:13,013 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:38:13,013 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:38:13,013 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 4d1dc6d5e0bd7eff97daa4fe943dbce7: 2023-07-12 13:38:13,054 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,054 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 20ad56ffb65cb5bab6d1f89dc701d381, disabling compactions & flushes 2023-07-12 13:38:13,054 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:38:13,054 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:38:13,054 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. after waiting 0 ms 2023-07-12 13:38:13,054 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:38:13,054 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:38:13,054 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 20ad56ffb65cb5bab6d1f89dc701d381: 2023-07-12 13:38:13,063 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 13:38:13,065 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,065 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,065 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,065 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,065 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,065 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,067 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,067 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,067 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,067 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,067 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,068 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,068 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,068 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,068 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,068 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,068 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,069 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689169093064"}]},"ts":"1689169093064"} 2023-07-12 13:38:13,122 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 26 regions to meta. 2023-07-12 13:38:13,127 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 13:38:13,128 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689169093127"}]},"ts":"1689169093127"} 2023-07-12 13:38:13,132 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLING in hbase:meta 2023-07-12 13:38:13,136 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 13:38:13,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 13:38:13,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 13:38:13,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 13:38:13,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 13:38:13,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec05a52723edbecd7be77f36806caa8a, ASSIGN}, {pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=216faae9d032640dca24ddf65ab9f909, ASSIGN}, {pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5140a4a30c94e149363cee692772d310, ASSIGN}, {pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=221aa1ce383e614c344b914ded3151c4, ASSIGN}, {pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e3b643504d1d8a33902c66ba6c8a69fd, ASSIGN}, {pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=555ad7ad110af9ec101b9dfc5a07fa5c, ASSIGN}, {pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=92478ee2b34576368e173be7ee67f2a5, ASSIGN}, {pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=260e260b05fbc83a4eb4ced4fbf3a9d8, ASSIGN}, {pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=912c554550dbcecd943b5e17bf1b23fc, ASSIGN}, {pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0bad15f8b77a93491f41e70639dc1fc8, ASSIGN}, {pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fd43ad19523fd1e39bad44724f1ef3da, ASSIGN}, {pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f9e1981fea95432fc8fb92eb7cc4524d, ASSIGN}, {pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=674f5b2fb0eacd68f031d75fb1103b80, ASSIGN}, {pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4d1dc6d5e0bd7eff97daa4fe943dbce7, ASSIGN}, {pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fa76a2771db04ba3b6a7d1be4a08daf8, ASSIGN}, {pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b38842d7461fd90c4f30b3afd99f11b8, ASSIGN}, {pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4641e91601e8baa52f8f326a3d617a38, ASSIGN}, {pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a623158b89e27dff4b3c43e771d2b672, ASSIGN}, {pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5c50497f7f74f39b808201e941fd8963, ASSIGN}, {pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=20ad56ffb65cb5bab6d1f89dc701d381, ASSIGN}, {pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=06b18c3992cc931e8054a4dcc480ece1, ASSIGN}, {pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6deb0a5007b6ff006e3a4a9f7e3b5f3d, ASSIGN}, {pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4e74d3136130f438093e2507612b0b5, ASSIGN}, {pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=736207afd3173343fa3290362bfa994d, ASSIGN}, {pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=98e8c1a65ac96e53d5bdaf4943cf497a, ASSIGN}, {pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=19ef6586ee290d893dc86ad8b10dd468, ASSIGN}] 2023-07-12 13:38:13,197 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=19ef6586ee290d893dc86ad8b10dd468, ASSIGN 2023-07-12 13:38:13,198 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=19ef6586ee290d893dc86ad8b10dd468, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35445,1689169089256; forceNewPlan=false, retain=false 2023-07-12 13:38:13,200 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=98e8c1a65ac96e53d5bdaf4943cf497a, ASSIGN 2023-07-12 13:38:13,202 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=98e8c1a65ac96e53d5bdaf4943cf497a, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34091,1689169089223; forceNewPlan=false, retain=false 2023-07-12 13:38:13,203 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=736207afd3173343fa3290362bfa994d, ASSIGN 2023-07-12 13:38:13,205 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=736207afd3173343fa3290362bfa994d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39081,1689169089182; forceNewPlan=false, retain=false 2023-07-12 13:38:13,206 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4e74d3136130f438093e2507612b0b5, ASSIGN 2023-07-12 13:38:13,208 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4e74d3136130f438093e2507612b0b5, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35445,1689169089256; forceNewPlan=false, retain=false 2023-07-12 13:38:13,209 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6deb0a5007b6ff006e3a4a9f7e3b5f3d, ASSIGN 2023-07-12 13:38:13,213 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6deb0a5007b6ff006e3a4a9f7e3b5f3d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34091,1689169089223; forceNewPlan=false, retain=false 2023-07-12 13:38:13,214 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=06b18c3992cc931e8054a4dcc480ece1, ASSIGN 2023-07-12 13:38:13,216 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=06b18c3992cc931e8054a4dcc480ece1, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39081,1689169089182; forceNewPlan=false, retain=false 2023-07-12 13:38:13,217 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=20ad56ffb65cb5bab6d1f89dc701d381, ASSIGN 2023-07-12 13:38:13,218 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=20ad56ffb65cb5bab6d1f89dc701d381, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34091,1689169089223; forceNewPlan=false, retain=false 2023-07-12 13:38:13,220 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5c50497f7f74f39b808201e941fd8963, ASSIGN 2023-07-12 13:38:13,221 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5c50497f7f74f39b808201e941fd8963, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35445,1689169089256; forceNewPlan=false, retain=false 2023-07-12 13:38:13,222 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a623158b89e27dff4b3c43e771d2b672, ASSIGN 2023-07-12 13:38:13,223 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a623158b89e27dff4b3c43e771d2b672, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34091,1689169089223; forceNewPlan=false, retain=false 2023-07-12 13:38:13,224 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4641e91601e8baa52f8f326a3d617a38, ASSIGN 2023-07-12 13:38:13,225 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4641e91601e8baa52f8f326a3d617a38, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39081,1689169089182; forceNewPlan=false, retain=false 2023-07-12 13:38:13,227 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b38842d7461fd90c4f30b3afd99f11b8, ASSIGN 2023-07-12 13:38:13,229 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b38842d7461fd90c4f30b3afd99f11b8, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35445,1689169089256; forceNewPlan=false, retain=false 2023-07-12 13:38:13,230 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fa76a2771db04ba3b6a7d1be4a08daf8, ASSIGN 2023-07-12 13:38:13,232 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fa76a2771db04ba3b6a7d1be4a08daf8, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34091,1689169089223; forceNewPlan=false, retain=false 2023-07-12 13:38:13,233 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4d1dc6d5e0bd7eff97daa4fe943dbce7, ASSIGN 2023-07-12 13:38:13,234 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4d1dc6d5e0bd7eff97daa4fe943dbce7, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39081,1689169089182; forceNewPlan=false, retain=false 2023-07-12 13:38:13,235 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=674f5b2fb0eacd68f031d75fb1103b80, ASSIGN 2023-07-12 13:38:13,236 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=674f5b2fb0eacd68f031d75fb1103b80, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39081,1689169089182; forceNewPlan=false, retain=false 2023-07-12 13:38:13,237 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f9e1981fea95432fc8fb92eb7cc4524d, ASSIGN 2023-07-12 13:38:13,238 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f9e1981fea95432fc8fb92eb7cc4524d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34091,1689169089223; forceNewPlan=false, retain=false 2023-07-12 13:38:13,239 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fd43ad19523fd1e39bad44724f1ef3da, ASSIGN 2023-07-12 13:38:13,240 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fd43ad19523fd1e39bad44724f1ef3da, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35445,1689169089256; forceNewPlan=false, retain=false 2023-07-12 13:38:13,241 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0bad15f8b77a93491f41e70639dc1fc8, ASSIGN 2023-07-12 13:38:13,242 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0bad15f8b77a93491f41e70639dc1fc8, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39081,1689169089182; forceNewPlan=false, retain=false 2023-07-12 13:38:13,244 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=912c554550dbcecd943b5e17bf1b23fc, ASSIGN 2023-07-12 13:38:13,245 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=912c554550dbcecd943b5e17bf1b23fc, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34091,1689169089223; forceNewPlan=false, retain=false 2023-07-12 13:38:13,246 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=260e260b05fbc83a4eb4ced4fbf3a9d8, ASSIGN 2023-07-12 13:38:13,248 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=260e260b05fbc83a4eb4ced4fbf3a9d8, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35445,1689169089256; forceNewPlan=false, retain=false 2023-07-12 13:38:13,249 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=92478ee2b34576368e173be7ee67f2a5, ASSIGN 2023-07-12 13:38:13,250 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=92478ee2b34576368e173be7ee67f2a5, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39081,1689169089182; forceNewPlan=false, retain=false 2023-07-12 13:38:13,251 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=555ad7ad110af9ec101b9dfc5a07fa5c, ASSIGN 2023-07-12 13:38:13,253 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=555ad7ad110af9ec101b9dfc5a07fa5c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34091,1689169089223; forceNewPlan=false, retain=false 2023-07-12 13:38:13,254 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e3b643504d1d8a33902c66ba6c8a69fd, ASSIGN 2023-07-12 13:38:13,255 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e3b643504d1d8a33902c66ba6c8a69fd, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35445,1689169089256; forceNewPlan=false, retain=false 2023-07-12 13:38:13,256 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=221aa1ce383e614c344b914ded3151c4, ASSIGN 2023-07-12 13:38:13,257 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=221aa1ce383e614c344b914ded3151c4, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39081,1689169089182; forceNewPlan=false, retain=false 2023-07-12 13:38:13,258 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5140a4a30c94e149363cee692772d310, ASSIGN 2023-07-12 13:38:13,259 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5140a4a30c94e149363cee692772d310, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,39081,1689169089182; forceNewPlan=false, retain=false 2023-07-12 13:38:13,259 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=216faae9d032640dca24ddf65ab9f909, ASSIGN 2023-07-12 13:38:13,260 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=216faae9d032640dca24ddf65ab9f909, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34091,1689169089223; forceNewPlan=false, retain=false 2023-07-12 13:38:13,261 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec05a52723edbecd7be77f36806caa8a, ASSIGN 2023-07-12 13:38:13,262 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec05a52723edbecd7be77f36806caa8a, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35445,1689169089256; forceNewPlan=false, retain=false 2023-07-12 13:38:13,349 INFO [jenkins-hbase17:42137] balancer.BaseLoadBalancer(1545): Reassigned 26 regions. 26 retained the pre-restart assignment. 2023-07-12 13:38:13,361 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=06b18c3992cc931e8054a4dcc480ece1, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,361 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093361"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093361"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093361"}]},"ts":"1689169093361"} 2023-07-12 13:38:13,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=30, state=RUNNABLE; OpenRegionProcedure 06b18c3992cc931e8054a4dcc480ece1, server=jenkins-hbase17.apache.org,39081,1689169089182}] 2023-07-12 13:38:13,369 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=674f5b2fb0eacd68f031d75fb1103b80, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,369 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093369"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093369"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093369"}]},"ts":"1689169093369"} 2023-07-12 13:38:13,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=22, state=RUNNABLE; OpenRegionProcedure 674f5b2fb0eacd68f031d75fb1103b80, server=jenkins-hbase17.apache.org,39081,1689169089182}] 2023-07-12 13:38:13,377 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=221aa1ce383e614c344b914ded3151c4, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,378 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093377"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093377"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093377"}]},"ts":"1689169093377"} 2023-07-12 13:38:13,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=38, ppid=13, state=RUNNABLE; OpenRegionProcedure 221aa1ce383e614c344b914ded3151c4, server=jenkins-hbase17.apache.org,39081,1689169089182}] 2023-07-12 13:38:13,386 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=92478ee2b34576368e173be7ee67f2a5, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,386 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093386"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093386"}]},"ts":"1689169093386"} 2023-07-12 13:38:13,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=16, state=RUNNABLE; OpenRegionProcedure 92478ee2b34576368e173be7ee67f2a5, server=jenkins-hbase17.apache.org,39081,1689169089182}] 2023-07-12 13:38:13,395 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5140a4a30c94e149363cee692772d310, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,395 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093395"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093395"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093395"}]},"ts":"1689169093395"} 2023-07-12 13:38:13,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=12, state=RUNNABLE; OpenRegionProcedure 5140a4a30c94e149363cee692772d310, server=jenkins-hbase17.apache.org,39081,1689169089182}] 2023-07-12 13:38:13,403 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0bad15f8b77a93491f41e70639dc1fc8, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,404 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093403"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093403"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093403"}]},"ts":"1689169093403"} 2023-07-12 13:38:13,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=19, state=RUNNABLE; OpenRegionProcedure 0bad15f8b77a93491f41e70639dc1fc8, server=jenkins-hbase17.apache.org,39081,1689169089182}] 2023-07-12 13:38:13,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:38:13,413 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4d1dc6d5e0bd7eff97daa4fe943dbce7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,413 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093413"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093413"}]},"ts":"1689169093413"} 2023-07-12 13:38:13,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=42, ppid=23, state=RUNNABLE; OpenRegionProcedure 4d1dc6d5e0bd7eff97daa4fe943dbce7, server=jenkins-hbase17.apache.org,39081,1689169089182}] 2023-07-12 13:38:13,421 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=4641e91601e8baa52f8f326a3d617a38, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,421 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093421"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093421"}]},"ts":"1689169093421"} 2023-07-12 13:38:13,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=26, state=RUNNABLE; OpenRegionProcedure 4641e91601e8baa52f8f326a3d617a38, server=jenkins-hbase17.apache.org,39081,1689169089182}] 2023-07-12 13:38:13,428 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=736207afd3173343fa3290362bfa994d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,428 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093428"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093428"}]},"ts":"1689169093428"} 2023-07-12 13:38:13,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=33, state=RUNNABLE; OpenRegionProcedure 736207afd3173343fa3290362bfa994d, server=jenkins-hbase17.apache.org,39081,1689169089182}] 2023-07-12 13:38:13,435 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=260e260b05fbc83a4eb4ced4fbf3a9d8, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,435 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093435"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093435"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093435"}]},"ts":"1689169093435"} 2023-07-12 13:38:13,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=17, state=RUNNABLE; OpenRegionProcedure 260e260b05fbc83a4eb4ced4fbf3a9d8, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:38:13,441 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=fd43ad19523fd1e39bad44724f1ef3da, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,441 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093441"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093441"}]},"ts":"1689169093441"} 2023-07-12 13:38:13,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=20, state=RUNNABLE; OpenRegionProcedure fd43ad19523fd1e39bad44724f1ef3da, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:38:13,447 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ec05a52723edbecd7be77f36806caa8a, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,447 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689169093447"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093447"}]},"ts":"1689169093447"} 2023-07-12 13:38:13,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=10, state=RUNNABLE; OpenRegionProcedure ec05a52723edbecd7be77f36806caa8a, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:38:13,453 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e3b643504d1d8a33902c66ba6c8a69fd, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,453 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093453"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093453"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093453"}]},"ts":"1689169093453"} 2023-07-12 13:38:13,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=14, state=RUNNABLE; OpenRegionProcedure e3b643504d1d8a33902c66ba6c8a69fd, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:38:13,459 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=19ef6586ee290d893dc86ad8b10dd468, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,459 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689169093459"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093459"}]},"ts":"1689169093459"} 2023-07-12 13:38:13,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=35, state=RUNNABLE; OpenRegionProcedure 19ef6586ee290d893dc86ad8b10dd468, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:38:13,464 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5c50497f7f74f39b808201e941fd8963, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,464 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093464"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093464"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093464"}]},"ts":"1689169093464"} 2023-07-12 13:38:13,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=28, state=RUNNABLE; OpenRegionProcedure 5c50497f7f74f39b808201e941fd8963, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:38:13,469 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=c4e74d3136130f438093e2507612b0b5, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,470 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093469"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093469"}]},"ts":"1689169093469"} 2023-07-12 13:38:13,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=32, state=RUNNABLE; OpenRegionProcedure c4e74d3136130f438093e2507612b0b5, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:38:13,475 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=b38842d7461fd90c4f30b3afd99f11b8, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,475 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093475"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093475"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093475"}]},"ts":"1689169093475"} 2023-07-12 13:38:13,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=25, state=RUNNABLE; OpenRegionProcedure b38842d7461fd90c4f30b3afd99f11b8, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:38:13,482 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=912c554550dbcecd943b5e17bf1b23fc, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,483 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093482"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093482"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093482"}]},"ts":"1689169093482"} 2023-07-12 13:38:13,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=18, state=RUNNABLE; OpenRegionProcedure 912c554550dbcecd943b5e17bf1b23fc, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:38:13,492 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=a623158b89e27dff4b3c43e771d2b672, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,492 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093492"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093492"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093492"}]},"ts":"1689169093492"} 2023-07-12 13:38:13,495 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=27, state=RUNNABLE; OpenRegionProcedure a623158b89e27dff4b3c43e771d2b672, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:38:13,500 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=f9e1981fea95432fc8fb92eb7cc4524d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,500 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093499"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093499"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093499"}]},"ts":"1689169093499"} 2023-07-12 13:38:13,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=21, state=RUNNABLE; OpenRegionProcedure f9e1981fea95432fc8fb92eb7cc4524d, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:38:13,507 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=fa76a2771db04ba3b6a7d1be4a08daf8, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,507 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093507"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093507"}]},"ts":"1689169093507"} 2023-07-12 13:38:13,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=24, state=RUNNABLE; OpenRegionProcedure fa76a2771db04ba3b6a7d1be4a08daf8, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:38:13,514 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=6deb0a5007b6ff006e3a4a9f7e3b5f3d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,515 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093514"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093514"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093514"}]},"ts":"1689169093514"} 2023-07-12 13:38:13,516 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=31, state=RUNNABLE; OpenRegionProcedure 6deb0a5007b6ff006e3a4a9f7e3b5f3d, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:38:13,520 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=555ad7ad110af9ec101b9dfc5a07fa5c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,520 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093520"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093520"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093520"}]},"ts":"1689169093520"} 2023-07-12 13:38:13,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:38:13,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=15, state=RUNNABLE; OpenRegionProcedure 555ad7ad110af9ec101b9dfc5a07fa5c, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:38:13,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 674f5b2fb0eacd68f031d75fb1103b80, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2023-07-12 13:38:13,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:38:13,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:38:13,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:38:13,526 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:38:13,527 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=20ad56ffb65cb5bab6d1f89dc701d381, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,527 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093527"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093527"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093527"}]},"ts":"1689169093527"} 2023-07-12 13:38:13,528 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily11 2023-07-12 13:38:13,528 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily11 2023-07-12 13:38:13,528 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 674f5b2fb0eacd68f031d75fb1103b80 columnFamilyName colfamily11 2023-07-12 13:38:13,529 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(310): Store=674f5b2fb0eacd68f031d75fb1103b80/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,529 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:38:13,529 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=59, ppid=29, state=RUNNABLE; OpenRegionProcedure 20ad56ffb65cb5bab6d1f89dc701d381, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:38:13,531 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily21 2023-07-12 13:38:13,532 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily21 2023-07-12 13:38:13,532 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 674f5b2fb0eacd68f031d75fb1103b80 columnFamilyName colfamily21 2023-07-12 13:38:13,533 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(310): Store=674f5b2fb0eacd68f031d75fb1103b80/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,533 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:38:13,533 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=216faae9d032640dca24ddf65ab9f909, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,535 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093533"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093533"}]},"ts":"1689169093533"} 2023-07-12 13:38:13,537 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily31 2023-07-12 13:38:13,537 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily31 2023-07-12 13:38:13,538 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 674f5b2fb0eacd68f031d75fb1103b80 columnFamilyName colfamily31 2023-07-12 13:38:13,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=11, state=RUNNABLE; OpenRegionProcedure 216faae9d032640dca24ddf65ab9f909, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:38:13,538 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(310): Store=674f5b2fb0eacd68f031d75fb1103b80/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,543 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=98e8c1a65ac96e53d5bdaf4943cf497a, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:38:13,543 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093543"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169093543"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169093543"}]},"ts":"1689169093543"} 2023-07-12 13:38:13,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:38:13,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=34, state=RUNNABLE; OpenRegionProcedure 98e8c1a65ac96e53d5bdaf4943cf497a, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:38:13,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:38:13,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 674f5b2fb0eacd68f031d75fb1103b80; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65753271, jitterRate=-0.020199909806251526}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 674f5b2fb0eacd68f031d75fb1103b80: 2023-07-12 13:38:13,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80., pid=37, masterSystemTime=1689169093517 2023-07-12 13:38:13,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:38:13,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:38:13,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:38:13,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d1dc6d5e0bd7eff97daa4fe943dbce7, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2023-07-12 13:38:13,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:38:13,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:38:13,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:38:13,565 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:38:13,577 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=674f5b2fb0eacd68f031d75fb1103b80, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,578 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093577"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093577"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093577"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093577"}]},"ts":"1689169093577"} 2023-07-12 13:38:13,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=22 2023-07-12 13:38:13,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=22, state=SUCCESS; OpenRegionProcedure 674f5b2fb0eacd68f031d75fb1103b80, server=jenkins-hbase17.apache.org,39081,1689169089182 in 210 msec 2023-07-12 13:38:13,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=674f5b2fb0eacd68f031d75fb1103b80, ASSIGN in 401 msec 2023-07-12 13:38:13,601 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily11 2023-07-12 13:38:13,601 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily11 2023-07-12 13:38:13,602 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d1dc6d5e0bd7eff97daa4fe943dbce7 columnFamilyName colfamily11 2023-07-12 13:38:13,607 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(310): Store=4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,607 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:38:13,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:38:13,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4e74d3136130f438093e2507612b0b5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5.', STARTKEY => 'www', ENDKEY => 'xxx'} 2023-07-12 13:38:13,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true c4e74d3136130f438093e2507612b0b5 2023-07-12 13:38:13,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for c4e74d3136130f438093e2507612b0b5 2023-07-12 13:38:13,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for c4e74d3136130f438093e2507612b0b5 2023-07-12 13:38:13,612 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily21 2023-07-12 13:38:13,612 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily21 2023-07-12 13:38:13,613 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d1dc6d5e0bd7eff97daa4fe943dbce7 columnFamilyName colfamily21 2023-07-12 13:38:13,614 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(310): Store=4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,614 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:38:13,617 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily31 2023-07-12 13:38:13,617 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily31 2023-07-12 13:38:13,617 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d1dc6d5e0bd7eff97daa4fe943dbce7 columnFamilyName colfamily31 2023-07-12 13:38:13,618 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(310): Store=4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,622 INFO [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region c4e74d3136130f438093e2507612b0b5 2023-07-12 13:38:13,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:38:13,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:38:13,624 DEBUG [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/colfamily11 2023-07-12 13:38:13,625 DEBUG [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/colfamily11 2023-07-12 13:38:13,625 INFO [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4e74d3136130f438093e2507612b0b5 columnFamilyName colfamily11 2023-07-12 13:38:13,626 INFO [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] regionserver.HStore(310): Store=c4e74d3136130f438093e2507612b0b5/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,626 INFO [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region c4e74d3136130f438093e2507612b0b5 2023-07-12 13:38:13,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,628 DEBUG [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/colfamily21 2023-07-12 13:38:13,628 DEBUG [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/colfamily21 2023-07-12 13:38:13,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:38:13,629 INFO [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4e74d3136130f438093e2507612b0b5 columnFamilyName colfamily21 2023-07-12 13:38:13,630 INFO [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] regionserver.HStore(310): Store=c4e74d3136130f438093e2507612b0b5/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,630 INFO [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region c4e74d3136130f438093e2507612b0b5 2023-07-12 13:38:13,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,632 DEBUG [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/colfamily31 2023-07-12 13:38:13,632 DEBUG [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/colfamily31 2023-07-12 13:38:13,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4d1dc6d5e0bd7eff97daa4fe943dbce7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75234280, jitterRate=0.12107813358306885}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4d1dc6d5e0bd7eff97daa4fe943dbce7: 2023-07-12 13:38:13,633 INFO [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4e74d3136130f438093e2507612b0b5 columnFamilyName colfamily31 2023-07-12 13:38:13,633 INFO [StoreOpener-c4e74d3136130f438093e2507612b0b5-1] regionserver.HStore(310): Store=c4e74d3136130f438093e2507612b0b5/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7., pid=42, masterSystemTime=1689169093517 2023-07-12 13:38:13,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5 2023-07-12 13:38:13,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5 2023-07-12 13:38:13,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:38:13,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:38:13,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:38:13,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bad15f8b77a93491f41e70639dc1fc8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2023-07-12 13:38:13,639 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4d1dc6d5e0bd7eff97daa4fe943dbce7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:38:13,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,639 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093638"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093638"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093638"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093638"}]},"ts":"1689169093638"} 2023-07-12 13:38:13,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:38:13,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:38:13,641 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,641 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 13:38:13,641 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:38:13,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,647 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 13:38:13,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for c4e74d3136130f438093e2507612b0b5 2023-07-12 13:38:13,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=23 2023-07-12 13:38:13,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=23, state=SUCCESS; OpenRegionProcedure 4d1dc6d5e0bd7eff97daa4fe943dbce7, server=jenkins-hbase17.apache.org,39081,1689169089182 in 226 msec 2023-07-12 13:38:13,649 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily11 2023-07-12 13:38:13,650 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily11 2023-07-12 13:38:13,651 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bad15f8b77a93491f41e70639dc1fc8 columnFamilyName colfamily11 2023-07-12 13:38:13,651 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4d1dc6d5e0bd7eff97daa4fe943dbce7, ASSIGN in 463 msec 2023-07-12 13:38:13,652 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(310): Store=0bad15f8b77a93491f41e70639dc1fc8/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,652 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:38:13,654 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily21 2023-07-12 13:38:13,654 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily21 2023-07-12 13:38:13,655 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bad15f8b77a93491f41e70639dc1fc8 columnFamilyName colfamily21 2023-07-12 13:38:13,656 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(310): Store=0bad15f8b77a93491f41e70639dc1fc8/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,656 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:38:13,658 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily31 2023-07-12 13:38:13,658 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily31 2023-07-12 13:38:13,659 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bad15f8b77a93491f41e70639dc1fc8 columnFamilyName colfamily31 2023-07-12 13:38:13,660 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(310): Store=0bad15f8b77a93491f41e70639dc1fc8/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:38:13,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened c4e74d3136130f438093e2507612b0b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67331204, jitterRate=0.003313124179840088}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for c4e74d3136130f438093e2507612b0b5: 2023-07-12 13:38:13,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:38:13,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa76a2771db04ba3b6a7d1be4a08daf8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8.', STARTKEY => 'ooo', ENDKEY => 'ppp'} 2023-07-12 13:38:13,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5., pid=51, masterSystemTime=1689169093589 2023-07-12 13:38:13,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:38:13,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:38:13,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:38:13,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:38:13,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:38:13,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:38:13,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:38:13,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b38842d7461fd90c4f30b3afd99f11b8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2023-07-12 13:38:13,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:38:13,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:38:13,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:38:13,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:38:13,671 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=c4e74d3136130f438093e2507612b0b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,672 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093671"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093671"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093671"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093671"}]},"ts":"1689169093671"} 2023-07-12 13:38:13,676 INFO [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:38:13,677 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=32 2023-07-12 13:38:13,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=32, state=SUCCESS; OpenRegionProcedure c4e74d3136130f438093e2507612b0b5, server=jenkins-hbase17.apache.org,35445,1689169089256 in 202 msec 2023-07-12 13:38:13,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c4e74d3136130f438093e2507612b0b5, ASSIGN in 490 msec 2023-07-12 13:38:13,680 INFO [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:38:13,682 DEBUG [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/colfamily11 2023-07-12 13:38:13,682 DEBUG [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/colfamily11 2023-07-12 13:38:13,682 INFO [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa76a2771db04ba3b6a7d1be4a08daf8 columnFamilyName colfamily11 2023-07-12 13:38:13,683 INFO [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] regionserver.HStore(310): Store=fa76a2771db04ba3b6a7d1be4a08daf8/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,683 INFO [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:38:13,685 DEBUG [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/colfamily21 2023-07-12 13:38:13,685 DEBUG [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/colfamily21 2023-07-12 13:38:13,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,685 INFO [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa76a2771db04ba3b6a7d1be4a08daf8 columnFamilyName colfamily21 2023-07-12 13:38:13,686 DEBUG [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/colfamily11 2023-07-12 13:38:13,686 DEBUG [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/colfamily11 2023-07-12 13:38:13,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0bad15f8b77a93491f41e70639dc1fc8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60242062, jitterRate=-0.10232332348823547}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0bad15f8b77a93491f41e70639dc1fc8: 2023-07-12 13:38:13,686 INFO [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b38842d7461fd90c4f30b3afd99f11b8 columnFamilyName colfamily11 2023-07-12 13:38:13,686 INFO [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] regionserver.HStore(310): Store=fa76a2771db04ba3b6a7d1be4a08daf8/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,687 INFO [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] regionserver.HStore(310): Store=b38842d7461fd90c4f30b3afd99f11b8/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,687 INFO [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:38:13,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8., pid=41, masterSystemTime=1689169093517 2023-07-12 13:38:13,687 INFO [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:38:13,689 DEBUG [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/colfamily21 2023-07-12 13:38:13,689 DEBUG [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/colfamily21 2023-07-12 13:38:13,689 DEBUG [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/colfamily31 2023-07-12 13:38:13,689 DEBUG [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/colfamily31 2023-07-12 13:38:13,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:38:13,689 INFO [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b38842d7461fd90c4f30b3afd99f11b8 columnFamilyName colfamily21 2023-07-12 13:38:13,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:38:13,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:38:13,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5140a4a30c94e149363cee692772d310, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2023-07-12 13:38:13,690 INFO [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa76a2771db04ba3b6a7d1be4a08daf8 columnFamilyName colfamily31 2023-07-12 13:38:13,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 5140a4a30c94e149363cee692772d310 2023-07-12 13:38:13,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,690 INFO [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] regionserver.HStore(310): Store=b38842d7461fd90c4f30b3afd99f11b8/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,691 INFO [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:38:13,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 5140a4a30c94e149363cee692772d310 2023-07-12 13:38:13,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 5140a4a30c94e149363cee692772d310 2023-07-12 13:38:13,691 INFO [StoreOpener-fa76a2771db04ba3b6a7d1be4a08daf8-1] regionserver.HStore(310): Store=fa76a2771db04ba3b6a7d1be4a08daf8/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,691 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0bad15f8b77a93491f41e70639dc1fc8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,692 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093691"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093691"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093691"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093691"}]},"ts":"1689169093691"} 2023-07-12 13:38:13,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:38:13,694 DEBUG [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/colfamily31 2023-07-12 13:38:13,694 DEBUG [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/colfamily31 2023-07-12 13:38:13,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:38:13,695 INFO [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b38842d7461fd90c4f30b3afd99f11b8 columnFamilyName colfamily31 2023-07-12 13:38:13,695 INFO [StoreOpener-b38842d7461fd90c4f30b3afd99f11b8-1] regionserver.HStore(310): Store=b38842d7461fd90c4f30b3afd99f11b8/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=19 2023-07-12 13:38:13,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=19, state=SUCCESS; OpenRegionProcedure 0bad15f8b77a93491f41e70639dc1fc8, server=jenkins-hbase17.apache.org,39081,1689169089182 in 288 msec 2023-07-12 13:38:13,701 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 5140a4a30c94e149363cee692772d310 2023-07-12 13:38:13,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:38:13,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:38:13,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:38:13,704 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily11 2023-07-12 13:38:13,705 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily11 2023-07-12 13:38:13,705 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0bad15f8b77a93491f41e70639dc1fc8, ASSIGN in 515 msec 2023-07-12 13:38:13,705 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5140a4a30c94e149363cee692772d310 columnFamilyName colfamily11 2023-07-12 13:38:13,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,707 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(310): Store=5140a4a30c94e149363cee692772d310/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,708 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 5140a4a30c94e149363cee692772d310 2023-07-12 13:38:13,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened fa76a2771db04ba3b6a7d1be4a08daf8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63564084, jitterRate=-0.052821338176727295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for fa76a2771db04ba3b6a7d1be4a08daf8: 2023-07-12 13:38:13,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8., pid=56, masterSystemTime=1689169093641 2023-07-12 13:38:13,710 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily21 2023-07-12 13:38:13,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:38:13,710 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily21 2023-07-12 13:38:13,713 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5140a4a30c94e149363cee692772d310 columnFamilyName colfamily21 2023-07-12 13:38:13,715 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(310): Store=5140a4a30c94e149363cee692772d310/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,716 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 5140a4a30c94e149363cee692772d310 2023-07-12 13:38:13,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:38:13,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:38:13,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:38:13,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 555ad7ad110af9ec101b9dfc5a07fa5c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2023-07-12 13:38:13,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:38:13,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:38:13,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:38:13,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,728 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily31 2023-07-12 13:38:13,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b38842d7461fd90c4f30b3afd99f11b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65098211, jitterRate=-0.02996106445789337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,728 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily31 2023-07-12 13:38:13,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b38842d7461fd90c4f30b3afd99f11b8: 2023-07-12 13:38:13,728 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=fa76a2771db04ba3b6a7d1be4a08daf8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,729 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093728"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093728"}]},"ts":"1689169093728"} 2023-07-12 13:38:13,729 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5140a4a30c94e149363cee692772d310 columnFamilyName colfamily31 2023-07-12 13:38:13,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8., pid=52, masterSystemTime=1689169093589 2023-07-12 13:38:13,731 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(310): Store=5140a4a30c94e149363cee692772d310/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:38:13,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:38:13,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:38:13,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5c50497f7f74f39b808201e941fd8963, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2023-07-12 13:38:13,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 5c50497f7f74f39b808201e941fd8963 2023-07-12 13:38:13,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 5c50497f7f74f39b808201e941fd8963 2023-07-12 13:38:13,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 5c50497f7f74f39b808201e941fd8963 2023-07-12 13:38:13,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310 2023-07-12 13:38:13,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310 2023-07-12 13:38:13,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=24 2023-07-12 13:38:13,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=24, state=SUCCESS; OpenRegionProcedure fa76a2771db04ba3b6a7d1be4a08daf8, server=jenkins-hbase17.apache.org,34091,1689169089223 in 222 msec 2023-07-12 13:38:13,744 INFO [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:38:13,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fa76a2771db04ba3b6a7d1be4a08daf8, ASSIGN in 555 msec 2023-07-12 13:38:13,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,746 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=b38842d7461fd90c4f30b3afd99f11b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,747 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093746"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093746"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093746"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093746"}]},"ts":"1689169093746"} 2023-07-12 13:38:13,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 5140a4a30c94e149363cee692772d310 2023-07-12 13:38:13,752 INFO [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 5c50497f7f74f39b808201e941fd8963 2023-07-12 13:38:13,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=25 2023-07-12 13:38:13,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=25, state=SUCCESS; OpenRegionProcedure b38842d7461fd90c4f30b3afd99f11b8, server=jenkins-hbase17.apache.org,35445,1689169089256 in 273 msec 2023-07-12 13:38:13,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,758 DEBUG [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/colfamily11 2023-07-12 13:38:13,758 DEBUG [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/colfamily11 2023-07-12 13:38:13,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 5140a4a30c94e149363cee692772d310; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69785822, jitterRate=0.039889782667160034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 5140a4a30c94e149363cee692772d310: 2023-07-12 13:38:13,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=b38842d7461fd90c4f30b3afd99f11b8, ASSIGN in 569 msec 2023-07-12 13:38:13,760 INFO [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 555ad7ad110af9ec101b9dfc5a07fa5c columnFamilyName colfamily11 2023-07-12 13:38:13,761 INFO [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] regionserver.HStore(310): Store=555ad7ad110af9ec101b9dfc5a07fa5c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,761 INFO [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:38:13,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310., pid=40, masterSystemTime=1689169093517 2023-07-12 13:38:13,764 DEBUG [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/colfamily21 2023-07-12 13:38:13,764 DEBUG [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/colfamily21 2023-07-12 13:38:13,764 DEBUG [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/colfamily11 2023-07-12 13:38:13,764 DEBUG [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/colfamily11 2023-07-12 13:38:13,765 INFO [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 555ad7ad110af9ec101b9dfc5a07fa5c columnFamilyName colfamily21 2023-07-12 13:38:13,765 INFO [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c50497f7f74f39b808201e941fd8963 columnFamilyName colfamily11 2023-07-12 13:38:13,767 INFO [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] regionserver.HStore(310): Store=555ad7ad110af9ec101b9dfc5a07fa5c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,768 INFO [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:38:13,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:38:13,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:38:13,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:38:13,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92478ee2b34576368e173be7ee67f2a5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5.', STARTKEY => 'ggg', ENDKEY => 'hhh'} 2023-07-12 13:38:13,768 INFO [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] regionserver.HStore(310): Store=5c50497f7f74f39b808201e941fd8963/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,768 INFO [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 5c50497f7f74f39b808201e941fd8963 2023-07-12 13:38:13,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:38:13,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:38:13,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:38:13,771 DEBUG [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/colfamily21 2023-07-12 13:38:13,772 DEBUG [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/colfamily21 2023-07-12 13:38:13,772 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5140a4a30c94e149363cee692772d310, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,772 DEBUG [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/colfamily31 2023-07-12 13:38:13,772 DEBUG [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/colfamily31 2023-07-12 13:38:13,772 INFO [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c50497f7f74f39b808201e941fd8963 columnFamilyName colfamily21 2023-07-12 13:38:13,773 INFO [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 555ad7ad110af9ec101b9dfc5a07fa5c columnFamilyName colfamily31 2023-07-12 13:38:13,773 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093772"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093772"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093772"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093772"}]},"ts":"1689169093772"} 2023-07-12 13:38:13,773 INFO [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] regionserver.HStore(310): Store=5c50497f7f74f39b808201e941fd8963/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,773 INFO [StoreOpener-555ad7ad110af9ec101b9dfc5a07fa5c-1] regionserver.HStore(310): Store=555ad7ad110af9ec101b9dfc5a07fa5c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,774 INFO [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 5c50497f7f74f39b808201e941fd8963 2023-07-12 13:38:13,776 DEBUG [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/colfamily31 2023-07-12 13:38:13,776 DEBUG [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/colfamily31 2023-07-12 13:38:13,777 INFO [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c50497f7f74f39b808201e941fd8963 columnFamilyName colfamily31 2023-07-12 13:38:13,779 INFO [StoreOpener-5c50497f7f74f39b808201e941fd8963-1] regionserver.HStore(310): Store=5c50497f7f74f39b808201e941fd8963/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=12 2023-07-12 13:38:13,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=12, state=SUCCESS; OpenRegionProcedure 5140a4a30c94e149363cee692772d310, server=jenkins-hbase17.apache.org,39081,1689169089182 in 380 msec 2023-07-12 13:38:13,787 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:38:13,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963 2023-07-12 13:38:13,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963 2023-07-12 13:38:13,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:38:13,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5140a4a30c94e149363cee692772d310, ASSIGN in 598 msec 2023-07-12 13:38:13,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:38:13,791 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily11 2023-07-12 13:38:13,791 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily11 2023-07-12 13:38:13,792 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92478ee2b34576368e173be7ee67f2a5 columnFamilyName colfamily11 2023-07-12 13:38:13,793 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(310): Store=92478ee2b34576368e173be7ee67f2a5/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,793 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:38:13,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 5c50497f7f74f39b808201e941fd8963 2023-07-12 13:38:13,797 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily21 2023-07-12 13:38:13,798 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily21 2023-07-12 13:38:13,799 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92478ee2b34576368e173be7ee67f2a5 columnFamilyName colfamily21 2023-07-12 13:38:13,801 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(310): Store=92478ee2b34576368e173be7ee67f2a5/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,801 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:38:13,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:38:13,804 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily31 2023-07-12 13:38:13,805 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily31 2023-07-12 13:38:13,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,806 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92478ee2b34576368e173be7ee67f2a5 columnFamilyName colfamily31 2023-07-12 13:38:13,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 5c50497f7f74f39b808201e941fd8963; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68144019, jitterRate=0.01542501151561737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 5c50497f7f74f39b808201e941fd8963: 2023-07-12 13:38:13,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 555ad7ad110af9ec101b9dfc5a07fa5c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72387565, jitterRate=0.07865877449512482}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963., pid=50, masterSystemTime=1689169093589 2023-07-12 13:38:13,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 555ad7ad110af9ec101b9dfc5a07fa5c: 2023-07-12 13:38:13,808 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(310): Store=92478ee2b34576368e173be7ee67f2a5/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c., pid=58, masterSystemTime=1689169093641 2023-07-12 13:38:13,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:38:13,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:38:13,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:38:13,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:38:13,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:38:13,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 260e260b05fbc83a4eb4ced4fbf3a9d8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8.', STARTKEY => 'hhh', ENDKEY => 'iii'} 2023-07-12 13:38:13,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:38:13,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:38:13,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:38:13,816 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5c50497f7f74f39b808201e941fd8963, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,817 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093816"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093816"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093816"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093816"}]},"ts":"1689169093816"} 2023-07-12 13:38:13,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:38:13,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:38:13,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:38:13,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6deb0a5007b6ff006e3a4a9f7e3b5f3d, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d.', STARTKEY => 'vvv', ENDKEY => 'www'} 2023-07-12 13:38:13,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:38:13,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:38:13,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:38:13,819 INFO [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:38:13,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,822 INFO [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:38:13,823 DEBUG [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/colfamily11 2023-07-12 13:38:13,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:38:13,823 DEBUG [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/colfamily11 2023-07-12 13:38:13,824 INFO [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 260e260b05fbc83a4eb4ced4fbf3a9d8 columnFamilyName colfamily11 2023-07-12 13:38:13,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=28 2023-07-12 13:38:13,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=28, state=SUCCESS; OpenRegionProcedure 5c50497f7f74f39b808201e941fd8963, server=jenkins-hbase17.apache.org,35445,1689169089256 in 355 msec 2023-07-12 13:38:13,826 INFO [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] regionserver.HStore(310): Store=260e260b05fbc83a4eb4ced4fbf3a9d8/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,826 INFO [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:38:13,829 DEBUG [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/colfamily21 2023-07-12 13:38:13,829 DEBUG [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/colfamily21 2023-07-12 13:38:13,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5c50497f7f74f39b808201e941fd8963, ASSIGN in 638 msec 2023-07-12 13:38:13,830 INFO [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 260e260b05fbc83a4eb4ced4fbf3a9d8 columnFamilyName colfamily21 2023-07-12 13:38:13,832 INFO [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] regionserver.HStore(310): Store=260e260b05fbc83a4eb4ced4fbf3a9d8/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,832 INFO [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:38:13,832 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=555ad7ad110af9ec101b9dfc5a07fa5c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,833 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093832"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093832"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093832"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093832"}]},"ts":"1689169093832"} 2023-07-12 13:38:13,835 DEBUG [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/colfamily31 2023-07-12 13:38:13,835 DEBUG [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/colfamily31 2023-07-12 13:38:13,836 INFO [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 260e260b05fbc83a4eb4ced4fbf3a9d8 columnFamilyName colfamily31 2023-07-12 13:38:13,836 DEBUG [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/colfamily11 2023-07-12 13:38:13,836 DEBUG [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/colfamily11 2023-07-12 13:38:13,837 INFO [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6deb0a5007b6ff006e3a4a9f7e3b5f3d columnFamilyName colfamily11 2023-07-12 13:38:13,837 INFO [StoreOpener-260e260b05fbc83a4eb4ced4fbf3a9d8-1] regionserver.HStore(310): Store=260e260b05fbc83a4eb4ced4fbf3a9d8/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,839 INFO [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] regionserver.HStore(310): Store=6deb0a5007b6ff006e3a4a9f7e3b5f3d/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,839 INFO [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:38:13,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:38:13,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:38:13,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 92478ee2b34576368e173be7ee67f2a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63394979, jitterRate=-0.0553411990404129}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 92478ee2b34576368e173be7ee67f2a5: 2023-07-12 13:38:13,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5., pid=39, masterSystemTime=1689169093517 2023-07-12 13:38:13,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=15 2023-07-12 13:38:13,843 DEBUG [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/colfamily21 2023-07-12 13:38:13,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=15, state=SUCCESS; OpenRegionProcedure 555ad7ad110af9ec101b9dfc5a07fa5c, server=jenkins-hbase17.apache.org,34091,1689169089223 in 313 msec 2023-07-12 13:38:13,844 DEBUG [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/colfamily21 2023-07-12 13:38:13,846 INFO [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6deb0a5007b6ff006e3a4a9f7e3b5f3d columnFamilyName colfamily21 2023-07-12 13:38:13,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:38:13,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:38:13,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=555ad7ad110af9ec101b9dfc5a07fa5c, ASSIGN in 658 msec 2023-07-12 13:38:13,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:38:13,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 221aa1ce383e614c344b914ded3151c4, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2023-07-12 13:38:13,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:38:13,849 INFO [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] regionserver.HStore(310): Store=6deb0a5007b6ff006e3a4a9f7e3b5f3d/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,849 INFO [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:38:13,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:38:13,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:38:13,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:38:13,851 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=92478ee2b34576368e173be7ee67f2a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,852 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093850"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093850"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093850"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093850"}]},"ts":"1689169093850"} 2023-07-12 13:38:13,854 DEBUG [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/colfamily31 2023-07-12 13:38:13,854 DEBUG [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/colfamily31 2023-07-12 13:38:13,855 INFO [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6deb0a5007b6ff006e3a4a9f7e3b5f3d columnFamilyName colfamily31 2023-07-12 13:38:13,856 INFO [StoreOpener-6deb0a5007b6ff006e3a4a9f7e3b5f3d-1] regionserver.HStore(310): Store=6deb0a5007b6ff006e3a4a9f7e3b5f3d/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:38:13,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:38:13,861 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:38:13,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=16 2023-07-12 13:38:13,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=16, state=SUCCESS; OpenRegionProcedure 92478ee2b34576368e173be7ee67f2a5, server=jenkins-hbase17.apache.org,39081,1689169089182 in 469 msec 2023-07-12 13:38:13,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:38:13,868 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily11 2023-07-12 13:38:13,868 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily11 2023-07-12 13:38:13,869 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 221aa1ce383e614c344b914ded3151c4 columnFamilyName colfamily11 2023-07-12 13:38:13,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=92478ee2b34576368e173be7ee67f2a5, ASSIGN in 681 msec 2023-07-12 13:38:13,871 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(310): Store=221aa1ce383e614c344b914ded3151c4/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,872 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:38:13,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 260e260b05fbc83a4eb4ced4fbf3a9d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61260032, jitterRate=-0.08715438842773438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 260e260b05fbc83a4eb4ced4fbf3a9d8: 2023-07-12 13:38:13,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8., pid=45, masterSystemTime=1689169093589 2023-07-12 13:38:13,903 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily21 2023-07-12 13:38:13,903 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily21 2023-07-12 13:38:13,904 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 221aa1ce383e614c344b914ded3151c4 columnFamilyName colfamily21 2023-07-12 13:38:13,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:38:13,905 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(310): Store=221aa1ce383e614c344b914ded3151c4/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:38:13,905 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:38:13,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:38:13,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3b643504d1d8a33902c66ba6c8a69fd, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd.', STARTKEY => 'eee', ENDKEY => 'fff'} 2023-07-12 13:38:13,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:38:13,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:38:13,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:38:13,907 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=260e260b05fbc83a4eb4ced4fbf3a9d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,908 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093907"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093907"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093907"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093907"}]},"ts":"1689169093907"} 2023-07-12 13:38:13,908 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily31 2023-07-12 13:38:13,908 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily31 2023-07-12 13:38:13,909 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 221aa1ce383e614c344b914ded3151c4 columnFamilyName colfamily31 2023-07-12 13:38:13,910 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(310): Store=221aa1ce383e614c344b914ded3151c4/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 6deb0a5007b6ff006e3a4a9f7e3b5f3d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61128427, jitterRate=-0.0891154557466507}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 6deb0a5007b6ff006e3a4a9f7e3b5f3d: 2023-07-12 13:38:13,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4 2023-07-12 13:38:13,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d., pid=57, masterSystemTime=1689169093641 2023-07-12 13:38:13,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=17 2023-07-12 13:38:13,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=17, state=SUCCESS; OpenRegionProcedure 260e260b05fbc83a4eb4ced4fbf3a9d8, server=jenkins-hbase17.apache.org,35445,1689169089256 in 474 msec 2023-07-12 13:38:13,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4 2023-07-12 13:38:13,919 INFO [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:38:13,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:38:13,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:38:13,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:38:13,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20ad56ffb65cb5bab6d1f89dc701d381, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2023-07-12 13:38:13,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:38:13,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:38:13,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:38:13,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:38:13,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=260e260b05fbc83a4eb4ced4fbf3a9d8, ASSIGN in 733 msec 2023-07-12 13:38:13,928 DEBUG [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/colfamily11 2023-07-12 13:38:13,928 DEBUG [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/colfamily11 2023-07-12 13:38:13,929 INFO [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3b643504d1d8a33902c66ba6c8a69fd columnFamilyName colfamily11 2023-07-12 13:38:13,930 INFO [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] regionserver.HStore(310): Store=e3b643504d1d8a33902c66ba6c8a69fd/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,930 INFO [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:38:13,933 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=6deb0a5007b6ff006e3a4a9f7e3b5f3d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:13,933 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093933"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093933"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093933"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093933"}]},"ts":"1689169093933"} 2023-07-12 13:38:13,935 DEBUG [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/colfamily21 2023-07-12 13:38:13,935 DEBUG [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/colfamily21 2023-07-12 13:38:13,936 INFO [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3b643504d1d8a33902c66ba6c8a69fd columnFamilyName colfamily21 2023-07-12 13:38:13,938 INFO [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] regionserver.HStore(310): Store=e3b643504d1d8a33902c66ba6c8a69fd/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,938 INFO [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:38:13,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=31 2023-07-12 13:38:13,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=31, state=SUCCESS; OpenRegionProcedure 6deb0a5007b6ff006e3a4a9f7e3b5f3d, server=jenkins-hbase17.apache.org,34091,1689169089223 in 421 msec 2023-07-12 13:38:13,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6deb0a5007b6ff006e3a4a9f7e3b5f3d, ASSIGN in 759 msec 2023-07-12 13:38:13,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,953 INFO [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:38:13,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 221aa1ce383e614c344b914ded3151c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59788286, jitterRate=-0.10908511281013489}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 221aa1ce383e614c344b914ded3151c4: 2023-07-12 13:38:13,956 DEBUG [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/colfamily11 2023-07-12 13:38:13,956 DEBUG [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/colfamily11 2023-07-12 13:38:13,957 INFO [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20ad56ffb65cb5bab6d1f89dc701d381 columnFamilyName colfamily11 2023-07-12 13:38:13,958 INFO [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] regionserver.HStore(310): Store=20ad56ffb65cb5bab6d1f89dc701d381/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,958 INFO [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:38:13,960 DEBUG [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/colfamily31 2023-07-12 13:38:13,960 DEBUG [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/colfamily31 2023-07-12 13:38:13,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4., pid=38, masterSystemTime=1689169093517 2023-07-12 13:38:13,960 INFO [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3b643504d1d8a33902c66ba6c8a69fd columnFamilyName colfamily31 2023-07-12 13:38:13,961 DEBUG [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/colfamily21 2023-07-12 13:38:13,961 DEBUG [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/colfamily21 2023-07-12 13:38:13,961 INFO [StoreOpener-e3b643504d1d8a33902c66ba6c8a69fd-1] regionserver.HStore(310): Store=e3b643504d1d8a33902c66ba6c8a69fd/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,961 INFO [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20ad56ffb65cb5bab6d1f89dc701d381 columnFamilyName colfamily21 2023-07-12 13:38:13,963 INFO [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] regionserver.HStore(310): Store=20ad56ffb65cb5bab6d1f89dc701d381/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,963 INFO [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:38:13,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:38:13,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:38:13,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:38:13,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:38:13,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:38:13,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4641e91601e8baa52f8f326a3d617a38, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2023-07-12 13:38:13,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:38:13,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:38:13,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:38:13,967 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=221aa1ce383e614c344b914ded3151c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:13,967 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093967"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093967"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093967"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093967"}]},"ts":"1689169093967"} 2023-07-12 13:38:13,967 DEBUG [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/colfamily31 2023-07-12 13:38:13,967 DEBUG [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/colfamily31 2023-07-12 13:38:13,968 INFO [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20ad56ffb65cb5bab6d1f89dc701d381 columnFamilyName colfamily31 2023-07-12 13:38:13,969 INFO [StoreOpener-20ad56ffb65cb5bab6d1f89dc701d381-1] regionserver.HStore(310): Store=20ad56ffb65cb5bab6d1f89dc701d381/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:38:13,973 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=13 2023-07-12 13:38:13,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=13, state=SUCCESS; OpenRegionProcedure 221aa1ce383e614c344b914ded3151c4, server=jenkins-hbase17.apache.org,39081,1689169089182 in 590 msec 2023-07-12 13:38:13,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=221aa1ce383e614c344b914ded3151c4, ASSIGN in 788 msec 2023-07-12 13:38:13,984 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:38:13,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:38:13,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:13,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:38:13,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e3b643504d1d8a33902c66ba6c8a69fd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60273025, jitterRate=-0.10186193883419037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:13,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e3b643504d1d8a33902c66ba6c8a69fd: 2023-07-12 13:38:13,987 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily11 2023-07-12 13:38:13,988 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily11 2023-07-12 13:38:13,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd., pid=48, masterSystemTime=1689169093589 2023-07-12 13:38:13,988 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4641e91601e8baa52f8f326a3d617a38 columnFamilyName colfamily11 2023-07-12 13:38:13,989 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(310): Store=4641e91601e8baa52f8f326a3d617a38/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:13,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:38:13,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:38:13,990 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:38:13,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:38:13,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19ef6586ee290d893dc86ad8b10dd468, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468.', STARTKEY => 'zzz', ENDKEY => ''} 2023-07-12 13:38:13,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:38:13,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:13,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:38:13,991 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e3b643504d1d8a33902c66ba6c8a69fd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:13,992 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169093991"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169093991"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169093991"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169093991"}]},"ts":"1689169093991"} 2023-07-12 13:38:13,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:38:13,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:38:13,996 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily21 2023-07-12 13:38:13,996 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily21 2023-07-12 13:38:13,997 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4641e91601e8baa52f8f326a3d617a38 columnFamilyName colfamily21 2023-07-12 13:38:13,998 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(310): Store=4641e91601e8baa52f8f326a3d617a38/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:13,998 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:38:13,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=14 2023-07-12 13:38:13,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=14, state=SUCCESS; OpenRegionProcedure e3b643504d1d8a33902c66ba6c8a69fd, server=jenkins-hbase17.apache.org,35445,1689169089256 in 540 msec 2023-07-12 13:38:14,000 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily31 2023-07-12 13:38:14,000 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily31 2023-07-12 13:38:14,001 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4641e91601e8baa52f8f326a3d617a38 columnFamilyName colfamily31 2023-07-12 13:38:14,002 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(310): Store=4641e91601e8baa52f8f326a3d617a38/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,002 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e3b643504d1d8a33902c66ba6c8a69fd, ASSIGN in 813 msec 2023-07-12 13:38:14,008 INFO [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:38:14,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:38:14,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 20ad56ffb65cb5bab6d1f89dc701d381; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69296255, jitterRate=0.03259466588497162}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 20ad56ffb65cb5bab6d1f89dc701d381: 2023-07-12 13:38:14,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:38:14,013 DEBUG [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/colfamily11 2023-07-12 13:38:14,013 DEBUG [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/colfamily11 2023-07-12 13:38:14,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381., pid=59, masterSystemTime=1689169093641 2023-07-12 13:38:14,014 INFO [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19ef6586ee290d893dc86ad8b10dd468 columnFamilyName colfamily11 2023-07-12 13:38:14,015 INFO [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] regionserver.HStore(310): Store=19ef6586ee290d893dc86ad8b10dd468/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,016 INFO [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:38:14,019 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=20ad56ffb65cb5bab6d1f89dc701d381, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:14,019 DEBUG [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/colfamily21 2023-07-12 13:38:14,019 DEBUG [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/colfamily21 2023-07-12 13:38:14,019 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169094018"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094018"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094018"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094018"}]},"ts":"1689169094018"} 2023-07-12 13:38:14,019 INFO [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19ef6586ee290d893dc86ad8b10dd468 columnFamilyName colfamily21 2023-07-12 13:38:14,021 INFO [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] regionserver.HStore(310): Store=19ef6586ee290d893dc86ad8b10dd468/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,021 INFO [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:38:14,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:14,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:38:14,024 DEBUG [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/colfamily31 2023-07-12 13:38:14,025 DEBUG [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/colfamily31 2023-07-12 13:38:14,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:38:14,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:38:14,025 INFO [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19ef6586ee290d893dc86ad8b10dd468 columnFamilyName colfamily31 2023-07-12 13:38:14,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f9e1981fea95432fc8fb92eb7cc4524d, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d.', STARTKEY => 'lll', ENDKEY => 'mmm'} 2023-07-12 13:38:14,026 INFO [StoreOpener-19ef6586ee290d893dc86ad8b10dd468-1] regionserver.HStore(310): Store=19ef6586ee290d893dc86ad8b10dd468/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:38:14,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:14,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:38:14,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:38:14,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:38:14,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:38:14,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:38:14,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=29 2023-07-12 13:38:14,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=29, state=SUCCESS; OpenRegionProcedure 20ad56ffb65cb5bab6d1f89dc701d381, server=jenkins-hbase17.apache.org,34091,1689169089223 in 495 msec 2023-07-12 13:38:14,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:14,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=20ad56ffb65cb5bab6d1f89dc701d381, ASSIGN in 846 msec 2023-07-12 13:38:14,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:38:14,041 INFO [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:38:14,056 DEBUG [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/colfamily11 2023-07-12 13:38:14,056 DEBUG [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/colfamily11 2023-07-12 13:38:14,057 INFO [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9e1981fea95432fc8fb92eb7cc4524d columnFamilyName colfamily11 2023-07-12 13:38:14,058 INFO [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] regionserver.HStore(310): Store=f9e1981fea95432fc8fb92eb7cc4524d/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,058 INFO [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:38:14,060 DEBUG [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/colfamily21 2023-07-12 13:38:14,060 DEBUG [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/colfamily21 2023-07-12 13:38:14,061 INFO [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9e1981fea95432fc8fb92eb7cc4524d columnFamilyName colfamily21 2023-07-12 13:38:14,062 INFO [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] regionserver.HStore(310): Store=f9e1981fea95432fc8fb92eb7cc4524d/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,062 INFO [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:38:14,064 DEBUG [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/colfamily31 2023-07-12 13:38:14,064 DEBUG [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/colfamily31 2023-07-12 13:38:14,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,064 INFO [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9e1981fea95432fc8fb92eb7cc4524d columnFamilyName colfamily31 2023-07-12 13:38:14,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 19ef6586ee290d893dc86ad8b10dd468; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65696343, jitterRate=-0.021048203110694885}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 19ef6586ee290d893dc86ad8b10dd468: 2023-07-12 13:38:14,065 INFO [StoreOpener-f9e1981fea95432fc8fb92eb7cc4524d-1] regionserver.HStore(310): Store=f9e1981fea95432fc8fb92eb7cc4524d/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468., pid=49, masterSystemTime=1689169093589 2023-07-12 13:38:14,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:38:14,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:38:14,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4641e91601e8baa52f8f326a3d617a38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71020230, jitterRate=0.05828389525413513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4641e91601e8baa52f8f326a3d617a38: 2023-07-12 13:38:14,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:38:14,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:38:14,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:38:14,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec05a52723edbecd7be77f36806caa8a, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a.', STARTKEY => '', ENDKEY => 'bbb'} 2023-07-12 13:38:14,071 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=19ef6586ee290d893dc86ad8b10dd468, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:14,072 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689169094071"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094071"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094071"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094071"}]},"ts":"1689169094071"} 2023-07-12 13:38:14,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38., pid=43, masterSystemTime=1689169093517 2023-07-12 13:38:14,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:38:14,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:14,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:38:14,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:38:14,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:14,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:38:14,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:38:14,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:38:14,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 06b18c3992cc931e8054a4dcc480ece1, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2023-07-12 13:38:14,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:38:14,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:14,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:38:14,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:38:14,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:38:14,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=35 2023-07-12 13:38:14,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=35, state=SUCCESS; OpenRegionProcedure 19ef6586ee290d893dc86ad8b10dd468, server=jenkins-hbase17.apache.org,35445,1689169089256 in 615 msec 2023-07-12 13:38:14,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=19ef6586ee290d893dc86ad8b10dd468, ASSIGN in 892 msec 2023-07-12 13:38:14,086 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=4641e91601e8baa52f8f326a3d617a38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:14,086 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169094085"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094085"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094085"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094085"}]},"ts":"1689169094085"} 2023-07-12 13:38:14,088 INFO [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:38:14,091 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:38:14,092 DEBUG [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/colfamily11 2023-07-12 13:38:14,092 DEBUG [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/colfamily11 2023-07-12 13:38:14,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=26 2023-07-12 13:38:14,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=26, state=SUCCESS; OpenRegionProcedure 4641e91601e8baa52f8f326a3d617a38, server=jenkins-hbase17.apache.org,39081,1689169089182 in 666 msec 2023-07-12 13:38:14,093 INFO [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec05a52723edbecd7be77f36806caa8a columnFamilyName colfamily11 2023-07-12 13:38:14,094 INFO [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] regionserver.HStore(310): Store=ec05a52723edbecd7be77f36806caa8a/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,094 INFO [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:38:14,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4641e91601e8baa52f8f326a3d617a38, ASSIGN in 907 msec 2023-07-12 13:38:14,096 DEBUG [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/colfamily21 2023-07-12 13:38:14,096 DEBUG [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/colfamily21 2023-07-12 13:38:14,096 INFO [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec05a52723edbecd7be77f36806caa8a columnFamilyName colfamily21 2023-07-12 13:38:14,098 INFO [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] regionserver.HStore(310): Store=ec05a52723edbecd7be77f36806caa8a/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,098 INFO [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:38:14,099 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily11 2023-07-12 13:38:14,099 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily11 2023-07-12 13:38:14,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,099 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06b18c3992cc931e8054a4dcc480ece1 columnFamilyName colfamily11 2023-07-12 13:38:14,100 DEBUG [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/colfamily31 2023-07-12 13:38:14,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened f9e1981fea95432fc8fb92eb7cc4524d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60691027, jitterRate=-0.09563322365283966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,100 DEBUG [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/colfamily31 2023-07-12 13:38:14,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for f9e1981fea95432fc8fb92eb7cc4524d: 2023-07-12 13:38:14,100 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(310): Store=06b18c3992cc931e8054a4dcc480ece1/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,100 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:38:14,100 INFO [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec05a52723edbecd7be77f36806caa8a columnFamilyName colfamily31 2023-07-12 13:38:14,106 INFO [StoreOpener-ec05a52723edbecd7be77f36806caa8a-1] regionserver.HStore(310): Store=ec05a52723edbecd7be77f36806caa8a/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d., pid=55, masterSystemTime=1689169093641 2023-07-12 13:38:14,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:38:14,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:38:14,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:14,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:38:14,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:38:14,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:38:14,119 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily21 2023-07-12 13:38:14,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:38:14,119 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily21 2023-07-12 13:38:14,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 216faae9d032640dca24ddf65ab9f909, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2023-07-12 13:38:14,119 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=f9e1981fea95432fc8fb92eb7cc4524d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:14,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 216faae9d032640dca24ddf65ab9f909 2023-07-12 13:38:14,119 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06b18c3992cc931e8054a4dcc480ece1 columnFamilyName colfamily21 2023-07-12 13:38:14,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:14,120 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169094119"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094119"}]},"ts":"1689169094119"} 2023-07-12 13:38:14,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 216faae9d032640dca24ddf65ab9f909 2023-07-12 13:38:14,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 216faae9d032640dca24ddf65ab9f909 2023-07-12 13:38:14,121 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(310): Store=06b18c3992cc931e8054a4dcc480ece1/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,122 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:38:14,124 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily31 2023-07-12 13:38:14,124 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily31 2023-07-12 13:38:14,124 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06b18c3992cc931e8054a4dcc480ece1 columnFamilyName colfamily31 2023-07-12 13:38:14,125 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(310): Store=06b18c3992cc931e8054a4dcc480ece1/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,126 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=21 2023-07-12 13:38:14,126 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=21, state=SUCCESS; OpenRegionProcedure f9e1981fea95432fc8fb92eb7cc4524d, server=jenkins-hbase17.apache.org,34091,1689169089223 in 620 msec 2023-07-12 13:38:14,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f9e1981fea95432fc8fb92eb7cc4524d, ASSIGN in 940 msec 2023-07-12 13:38:14,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:38:14,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:38:14,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:14,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:38:14,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened ec05a52723edbecd7be77f36806caa8a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65017070, jitterRate=-0.031170159578323364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for ec05a52723edbecd7be77f36806caa8a: 2023-07-12 13:38:14,139 INFO [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 216faae9d032640dca24ddf65ab9f909 2023-07-12 13:38:14,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a., pid=47, masterSystemTime=1689169093589 2023-07-12 13:38:14,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:38:14,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:38:14,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:38:14,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd43ad19523fd1e39bad44724f1ef3da, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2023-07-12 13:38:14,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:38:14,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:14,144 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ec05a52723edbecd7be77f36806caa8a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:14,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:38:14,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:38:14,144 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689169094143"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094143"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094143"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094143"}]},"ts":"1689169094143"} 2023-07-12 13:38:14,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,149 DEBUG [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/colfamily11 2023-07-12 13:38:14,149 DEBUG [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/colfamily11 2023-07-12 13:38:14,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 06b18c3992cc931e8054a4dcc480ece1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68990307, jitterRate=0.028035685420036316}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 06b18c3992cc931e8054a4dcc480ece1: 2023-07-12 13:38:14,150 INFO [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 216faae9d032640dca24ddf65ab9f909 columnFamilyName colfamily11 2023-07-12 13:38:14,150 INFO [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] regionserver.HStore(310): Store=216faae9d032640dca24ddf65ab9f909/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,151 INFO [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 216faae9d032640dca24ddf65ab9f909 2023-07-12 13:38:14,152 DEBUG [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/colfamily21 2023-07-12 13:38:14,152 DEBUG [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/colfamily21 2023-07-12 13:38:14,153 INFO [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 216faae9d032640dca24ddf65ab9f909 columnFamilyName colfamily21 2023-07-12 13:38:14,154 INFO [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] regionserver.HStore(310): Store=216faae9d032640dca24ddf65ab9f909/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,154 INFO [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 216faae9d032640dca24ddf65ab9f909 2023-07-12 13:38:14,156 DEBUG [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/colfamily31 2023-07-12 13:38:14,157 DEBUG [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/colfamily31 2023-07-12 13:38:14,157 INFO [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 216faae9d032640dca24ddf65ab9f909 columnFamilyName colfamily31 2023-07-12 13:38:14,159 INFO [StoreOpener-216faae9d032640dca24ddf65ab9f909-1] regionserver.HStore(310): Store=216faae9d032640dca24ddf65ab9f909/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=10 2023-07-12 13:38:14,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=10, state=SUCCESS; OpenRegionProcedure ec05a52723edbecd7be77f36806caa8a, server=jenkins-hbase17.apache.org,35445,1689169089256 in 698 msec 2023-07-12 13:38:14,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1., pid=36, masterSystemTime=1689169093517 2023-07-12 13:38:14,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:38:14,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:38:14,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:38:14,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 736207afd3173343fa3290362bfa994d, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2023-07-12 13:38:14,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 736207afd3173343fa3290362bfa994d 2023-07-12 13:38:14,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:14,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 736207afd3173343fa3290362bfa994d 2023-07-12 13:38:14,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 736207afd3173343fa3290362bfa994d 2023-07-12 13:38:14,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec05a52723edbecd7be77f36806caa8a, ASSIGN in 974 msec 2023-07-12 13:38:14,167 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=06b18c3992cc931e8054a4dcc480ece1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:14,167 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169094167"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094167"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094167"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094167"}]},"ts":"1689169094167"} 2023-07-12 13:38:14,171 INFO [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:38:14,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909 2023-07-12 13:38:14,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909 2023-07-12 13:38:14,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=30 2023-07-12 13:38:14,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=30, state=SUCCESS; OpenRegionProcedure 06b18c3992cc931e8054a4dcc480ece1, server=jenkins-hbase17.apache.org,39081,1689169089182 in 806 msec 2023-07-12 13:38:14,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:14,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=06b18c3992cc931e8054a4dcc480ece1, ASSIGN in 986 msec 2023-07-12 13:38:14,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 216faae9d032640dca24ddf65ab9f909 2023-07-12 13:38:14,179 DEBUG [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/colfamily11 2023-07-12 13:38:14,179 DEBUG [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/colfamily11 2023-07-12 13:38:14,179 INFO [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd43ad19523fd1e39bad44724f1ef3da columnFamilyName colfamily11 2023-07-12 13:38:14,180 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 736207afd3173343fa3290362bfa994d 2023-07-12 13:38:14,181 INFO [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] regionserver.HStore(310): Store=fd43ad19523fd1e39bad44724f1ef3da/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,181 INFO [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:38:14,182 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily11 2023-07-12 13:38:14,182 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily11 2023-07-12 13:38:14,182 DEBUG [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/colfamily21 2023-07-12 13:38:14,182 DEBUG [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/colfamily21 2023-07-12 13:38:14,183 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 736207afd3173343fa3290362bfa994d columnFamilyName colfamily11 2023-07-12 13:38:14,183 INFO [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd43ad19523fd1e39bad44724f1ef3da columnFamilyName colfamily21 2023-07-12 13:38:14,184 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(310): Store=736207afd3173343fa3290362bfa994d/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,184 INFO [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] regionserver.HStore(310): Store=fd43ad19523fd1e39bad44724f1ef3da/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,184 INFO [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:38:14,184 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 736207afd3173343fa3290362bfa994d 2023-07-12 13:38:14,186 DEBUG [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/colfamily31 2023-07-12 13:38:14,186 DEBUG [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/colfamily31 2023-07-12 13:38:14,187 INFO [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd43ad19523fd1e39bad44724f1ef3da columnFamilyName colfamily31 2023-07-12 13:38:14,187 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily21 2023-07-12 13:38:14,187 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily21 2023-07-12 13:38:14,188 INFO [StoreOpener-fd43ad19523fd1e39bad44724f1ef3da-1] regionserver.HStore(310): Store=fd43ad19523fd1e39bad44724f1ef3da/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,188 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 736207afd3173343fa3290362bfa994d columnFamilyName colfamily21 2023-07-12 13:38:14,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:38:14,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,189 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(310): Store=736207afd3173343fa3290362bfa994d/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,190 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 736207afd3173343fa3290362bfa994d 2023-07-12 13:38:14,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:38:14,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 216faae9d032640dca24ddf65ab9f909; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61933297, jitterRate=-0.07712195813655853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 216faae9d032640dca24ddf65ab9f909: 2023-07-12 13:38:14,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909., pid=60, masterSystemTime=1689169093641 2023-07-12 13:38:14,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:38:14,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:38:14,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:38:14,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 98e8c1a65ac96e53d5bdaf4943cf497a, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a.', STARTKEY => 'yyy', ENDKEY => 'zzz'} 2023-07-12 13:38:14,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:38:14,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:14,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:38:14,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:38:14,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:14,195 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily31 2023-07-12 13:38:14,195 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily31 2023-07-12 13:38:14,196 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=216faae9d032640dca24ddf65ab9f909, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:14,196 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 736207afd3173343fa3290362bfa994d columnFamilyName colfamily31 2023-07-12 13:38:14,196 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169094196"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094196"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094196"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094196"}]},"ts":"1689169094196"} 2023-07-12 13:38:14,197 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(310): Store=736207afd3173343fa3290362bfa994d/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:38:14,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=11 2023-07-12 13:38:14,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=11, state=SUCCESS; OpenRegionProcedure 216faae9d032640dca24ddf65ab9f909, server=jenkins-hbase17.apache.org,34091,1689169089223 in 660 msec 2023-07-12 13:38:14,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=216faae9d032640dca24ddf65ab9f909, ASSIGN in 1.0160 sec 2023-07-12 13:38:14,208 INFO [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:38:14,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d 2023-07-12 13:38:14,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened fd43ad19523fd1e39bad44724f1ef3da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74060738, jitterRate=0.10359099507331848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for fd43ad19523fd1e39bad44724f1ef3da: 2023-07-12 13:38:14,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d 2023-07-12 13:38:14,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da., pid=46, masterSystemTime=1689169093589 2023-07-12 13:38:14,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:38:14,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:38:14,231 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=fd43ad19523fd1e39bad44724f1ef3da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:14,231 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169094230"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094230"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094230"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094230"}]},"ts":"1689169094230"} 2023-07-12 13:38:14,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:14,231 DEBUG [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/colfamily11 2023-07-12 13:38:14,231 DEBUG [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/colfamily11 2023-07-12 13:38:14,232 INFO [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98e8c1a65ac96e53d5bdaf4943cf497a columnFamilyName colfamily11 2023-07-12 13:38:14,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 736207afd3173343fa3290362bfa994d 2023-07-12 13:38:14,236 INFO [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] regionserver.HStore(310): Store=98e8c1a65ac96e53d5bdaf4943cf497a/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,236 INFO [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:38:14,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=20 2023-07-12 13:38:14,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=20, state=SUCCESS; OpenRegionProcedure fd43ad19523fd1e39bad44724f1ef3da, server=jenkins-hbase17.apache.org,35445,1689169089256 in 791 msec 2023-07-12 13:38:14,239 DEBUG [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/colfamily21 2023-07-12 13:38:14,240 DEBUG [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/colfamily21 2023-07-12 13:38:14,241 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fd43ad19523fd1e39bad44724f1ef3da, ASSIGN in 1.0530 sec 2023-07-12 13:38:14,241 INFO [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98e8c1a65ac96e53d5bdaf4943cf497a columnFamilyName colfamily21 2023-07-12 13:38:14,242 INFO [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] regionserver.HStore(310): Store=98e8c1a65ac96e53d5bdaf4943cf497a/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,242 INFO [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:38:14,245 DEBUG [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/colfamily31 2023-07-12 13:38:14,245 DEBUG [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/colfamily31 2023-07-12 13:38:14,246 INFO [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98e8c1a65ac96e53d5bdaf4943cf497a columnFamilyName colfamily31 2023-07-12 13:38:14,247 INFO [StoreOpener-98e8c1a65ac96e53d5bdaf4943cf497a-1] regionserver.HStore(310): Store=98e8c1a65ac96e53d5bdaf4943cf497a/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:38:14,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:38:14,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:14,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:38:14,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 736207afd3173343fa3290362bfa994d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72474194, jitterRate=0.07994964718818665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 736207afd3173343fa3290362bfa994d: 2023-07-12 13:38:14,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d., pid=44, masterSystemTime=1689169093517 2023-07-12 13:38:14,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:38:14,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:38:14,268 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=736207afd3173343fa3290362bfa994d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:14,268 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169094268"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094268"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094268"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094268"}]},"ts":"1689169094268"} 2023-07-12 13:38:14,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 98e8c1a65ac96e53d5bdaf4943cf497a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73572823, jitterRate=0.0963204950094223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 98e8c1a65ac96e53d5bdaf4943cf497a: 2023-07-12 13:38:14,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a., pid=61, masterSystemTime=1689169093641 2023-07-12 13:38:14,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=33 2023-07-12 13:38:14,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=33, state=SUCCESS; OpenRegionProcedure 736207afd3173343fa3290362bfa994d, server=jenkins-hbase17.apache.org,39081,1689169089182 in 841 msec 2023-07-12 13:38:14,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:38:14,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:38:14,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:38:14,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a623158b89e27dff4b3c43e771d2b672, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672.', STARTKEY => 'rrr', ENDKEY => 'sss'} 2023-07-12 13:38:14,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:38:14,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:14,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:38:14,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:38:14,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=736207afd3173343fa3290362bfa994d, ASSIGN in 1.0870 sec 2023-07-12 13:38:14,279 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=98e8c1a65ac96e53d5bdaf4943cf497a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:14,279 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169094279"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094279"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094279"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094279"}]},"ts":"1689169094279"} 2023-07-12 13:38:14,282 INFO [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:38:14,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=34 2023-07-12 13:38:14,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=34, state=SUCCESS; OpenRegionProcedure 98e8c1a65ac96e53d5bdaf4943cf497a, server=jenkins-hbase17.apache.org,34091,1689169089223 in 737 msec 2023-07-12 13:38:14,294 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=98e8c1a65ac96e53d5bdaf4943cf497a, ASSIGN in 1.0980 sec 2023-07-12 13:38:14,300 DEBUG [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/colfamily11 2023-07-12 13:38:14,300 DEBUG [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/colfamily11 2023-07-12 13:38:14,302 INFO [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a623158b89e27dff4b3c43e771d2b672 columnFamilyName colfamily11 2023-07-12 13:38:14,303 INFO [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] regionserver.HStore(310): Store=a623158b89e27dff4b3c43e771d2b672/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,304 INFO [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:38:14,306 DEBUG [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/colfamily21 2023-07-12 13:38:14,306 DEBUG [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/colfamily21 2023-07-12 13:38:14,307 INFO [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a623158b89e27dff4b3c43e771d2b672 columnFamilyName colfamily21 2023-07-12 13:38:14,308 INFO [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] regionserver.HStore(310): Store=a623158b89e27dff4b3c43e771d2b672/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,308 INFO [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:38:14,310 DEBUG [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/colfamily31 2023-07-12 13:38:14,310 DEBUG [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/colfamily31 2023-07-12 13:38:14,311 INFO [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a623158b89e27dff4b3c43e771d2b672 columnFamilyName colfamily31 2023-07-12 13:38:14,312 INFO [StoreOpener-a623158b89e27dff4b3c43e771d2b672-1] regionserver.HStore(310): Store=a623158b89e27dff4b3c43e771d2b672/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:38:14,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:38:14,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:14,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:38:14,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a623158b89e27dff4b3c43e771d2b672; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62398242, jitterRate=-0.07019373774528503}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a623158b89e27dff4b3c43e771d2b672: 2023-07-12 13:38:14,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672., pid=54, masterSystemTime=1689169093641 2023-07-12 13:38:14,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:38:14,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:38:14,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:38:14,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 912c554550dbcecd943b5e17bf1b23fc, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2023-07-12 13:38:14,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:38:14,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:38:14,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:38:14,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:38:14,332 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=a623158b89e27dff4b3c43e771d2b672, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:14,332 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169094331"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094331"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094331"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094331"}]},"ts":"1689169094331"} 2023-07-12 13:38:14,334 INFO [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:38:14,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=27 2023-07-12 13:38:14,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=27, state=SUCCESS; OpenRegionProcedure a623158b89e27dff4b3c43e771d2b672, server=jenkins-hbase17.apache.org,34091,1689169089223 in 839 msec 2023-07-12 13:38:14,339 DEBUG [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/colfamily11 2023-07-12 13:38:14,340 DEBUG [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/colfamily11 2023-07-12 13:38:14,341 INFO [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 912c554550dbcecd943b5e17bf1b23fc columnFamilyName colfamily11 2023-07-12 13:38:14,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a623158b89e27dff4b3c43e771d2b672, ASSIGN in 1.1530 sec 2023-07-12 13:38:14,342 INFO [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] regionserver.HStore(310): Store=912c554550dbcecd943b5e17bf1b23fc/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,342 INFO [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:38:14,347 DEBUG [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/colfamily21 2023-07-12 13:38:14,347 DEBUG [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/colfamily21 2023-07-12 13:38:14,348 INFO [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 912c554550dbcecd943b5e17bf1b23fc columnFamilyName colfamily21 2023-07-12 13:38:14,349 INFO [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] regionserver.HStore(310): Store=912c554550dbcecd943b5e17bf1b23fc/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,349 INFO [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:38:14,355 DEBUG [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/colfamily31 2023-07-12 13:38:14,356 DEBUG [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/colfamily31 2023-07-12 13:38:14,358 INFO [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 912c554550dbcecd943b5e17bf1b23fc columnFamilyName colfamily31 2023-07-12 13:38:14,359 INFO [StoreOpener-912c554550dbcecd943b5e17bf1b23fc-1] regionserver.HStore(310): Store=912c554550dbcecd943b5e17bf1b23fc/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:38:14,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:38:14,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:38:14,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:38:14,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:38:14,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 13:38:14,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 912c554550dbcecd943b5e17bf1b23fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70087508, jitterRate=0.04438525438308716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:38:14,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 912c554550dbcecd943b5e17bf1b23fc: 2023-07-12 13:38:14,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc., pid=53, masterSystemTime=1689169093641 2023-07-12 13:38:14,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:38:14,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:38:14,393 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=912c554550dbcecd943b5e17bf1b23fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:14,393 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169094393"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169094393"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169094393"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169094393"}]},"ts":"1689169094393"} 2023-07-12 13:38:14,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=18 2023-07-12 13:38:14,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=18, state=SUCCESS; OpenRegionProcedure 912c554550dbcecd943b5e17bf1b23fc, server=jenkins-hbase17.apache.org,34091,1689169089223 in 912 msec 2023-07-12 13:38:14,408 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=9 2023-07-12 13:38:14,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=912c554550dbcecd943b5e17bf1b23fc, ASSIGN in 1.2150 sec 2023-07-12 13:38:14,410 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 13:38:14,411 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689169094411"}]},"ts":"1689169094411"} 2023-07-12 13:38:14,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:38:14,415 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLED in hbase:meta 2023-07-12 13:38:14,419 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 13:38:14,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true in 2.1480 sec 2023-07-12 13:38:16,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 13:38:16,417 INFO [Listener at localhost.localdomain/40361] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, procId: 9 completed 2023-07-12 13:38:16,417 DEBUG [Listener at localhost.localdomain/40361] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true get assigned. Timeout = 60000ms 2023-07-12 13:38:16,420 INFO [Listener at localhost.localdomain/40361] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 13:38:16,429 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39081] regionserver.StoreScanner(1093): Switch to stream read (scanned=32976 bytes) of info 2023-07-12 13:38:16,443 INFO [Listener at localhost.localdomain/40361] hbase.HBaseTestingUtility(3484): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned to meta. Checking AM states. 2023-07-12 13:38:16,443 INFO [Listener at localhost.localdomain/40361] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 13:38:16,443 INFO [Listener at localhost.localdomain/40361] hbase.HBaseTestingUtility(3504): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned. 2023-07-12 13:38:16,587 DEBUG [hconnection-0x5b9b07b5-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:38:16,587 DEBUG [hconnection-0x5b9b07b5-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 13:38:16,615 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:38:16,615 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:38:16,640 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39081] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6327 Client: jenkins//136.243.18.41 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:38:16,640 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34091] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6327 Client: jenkins//136.243.18.41 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:38:16,737 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:38:16,913 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 13:38:16,916 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true' 2023-07-12 13:38:16,918 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 13:38:16,920 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 13:38:16,938 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 13:38:16,952 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 13:38:16,961 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 13:38:16,970 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 13:38:16,977 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 13:38:16,987 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 13:38:16,994 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 13:38:17,000 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 13:38:17,006 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 13:38:17,012 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 13:38:17,019 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 13:38:17,024 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 13:38:17,030 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 13:38:17,036 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 13:38:17,041 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 13:38:17,047 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 13:38:17,053 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 13:38:17,059 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 13:38:17,065 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 13:38:17,080 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 13:38:17,089 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 13:38:17,093 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 13:38:17,098 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 13:38:17,103 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 13:38:17,112 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 13:38:17,117 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 13:38:17,122 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 13:38:17,127 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 13:38:17,130 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 13:38:17,136 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 13:38:17,140 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 13:38:17,144 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 13:38:17,149 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 13:38:17,153 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 13:38:17,158 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 13:38:17,163 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 13:38:17,167 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 13:38:17,171 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 13:38:17,176 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 13:38:17,180 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 13:38:17,184 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 13:38:17,187 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 13:38:17,191 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 13:38:17,195 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 13:38:17,198 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 13:38:17,201 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 13:38:17,204 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 13:38:17,208 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 13:38:17,211 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 13:38:17,479 WARN [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: true 2023-07-12 13:38:17,479 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentTestingUtil(82): KILL REGION SERVER jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:17,480 INFO [Listener at localhost.localdomain/40361] hbase.MiniHBaseCluster(271): Killing jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:17,484 ERROR [Listener at localhost.localdomain/40361] helpers.MarkerIgnoringBase(143): ***** ABORTING region server jenkins-hbase17.apache.org,39081,1689169089182: Simulated kill ***** 2023-07-12 13:38:17,485 ERROR [Listener at localhost.localdomain/40361] helpers.MarkerIgnoringBase(143): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2023-07-12 13:38:17,495 DEBUG [Listener at localhost.localdomain/40361] util.JSONBean(130): Listing beans for java.lang:type=Memory 2023-07-12 13:38:17,532 DEBUG [Listener at localhost.localdomain/40361] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=IPC 2023-07-12 13:38:17,548 DEBUG [Listener at localhost.localdomain/40361] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Replication 2023-07-12 13:38:17,551 DEBUG [Listener at localhost.localdomain/40361] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Server 2023-07-12 13:38:17,559 INFO [Listener at localhost.localdomain/40361] regionserver.HRegionServer(2557): Dump of metrics as JSON on abort: { "beans": [ { "name": "java.lang:type=Memory", "modelerType": "sun.management.MemoryImpl", "ObjectPendingFinalizationCount": 0, "HeapMemoryUsage": { "committed": 985137152, "init": 524288000, "max": 2051014656, "used": 246975440 }, "NonHeapMemoryUsage": { "committed": 128933888, "init": 2555904, "max": -1, "used": 126611136 }, "Verbose": false, "ObjectName": "java.lang:type=Memory" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=IPC", "modelerType": "RegionServer,sub=IPC", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase17.apache.org", "queueSize": 0, "numCallsInGeneralQueue": 0, "numCallsInReplicationQueue": 0, "numCallsInPriorityQueue": 0, "numCallsInMetaPriorityQueue": 0, "numOpenConnections": 3, "numActiveHandler": 0, "numActiveGeneralHandler": 0, "numActivePriorityHandler": 0, "numActiveReplicationHandler": 0, "numGeneralCallsDropped": 0, "numLifoModeSwitches": 0, "numCallsInWriteQueue": 0, "numCallsInReadQueue": 0, "numCallsInScanQueue": 0, "numActiveWriteHandler": 0, "numActiveReadHandler": 0, "numActiveScanHandler": 0, "nettyDirectMemoryUsage": 67108864, "receivedBytes": 1470913, "exceptions.RegionMovedException": 0, "authenticationSuccesses": 0, "authorizationFailures": 0, "exceptions.requestTooBig": 0, "exceptions.OutOfOrderScannerNextException": 0, "exceptions.rpcThrottling": 0, "exceptions.otherExceptions": 0, "ProcessCallTime_num_ops": 160, "ProcessCallTime_min": 0, "ProcessCallTime_max": 150, "ProcessCallTime_mean": 4, "ProcessCallTime_25th_percentile": 37, "ProcessCallTime_median": 75, "ProcessCallTime_75th_percentile": 112, "ProcessCallTime_90th_percentile": 135, "ProcessCallTime_95th_percentile": 142, "ProcessCallTime_98th_percentile": 147, "ProcessCallTime_99th_percentile": 148, "ProcessCallTime_99.9th_percentile": 149, "ProcessCallTime_TimeRangeCount_0-1": 160, "exceptions.callQueueTooBig": 0, "QueueCallTime_num_ops": 160, "QueueCallTime_min": 0, "QueueCallTime_max": 1, "QueueCallTime_mean": 0, "QueueCallTime_25th_percentile": 0, "QueueCallTime_median": 0, "QueueCallTime_75th_percentile": 0, "QueueCallTime_90th_percentile": 0, "QueueCallTime_95th_percentile": 0, "QueueCallTime_98th_percentile": 0, "QueueCallTime_99th_percentile": 0, "QueueCallTime_99.9th_percentile": 0, "QueueCallTime_TimeRangeCount_0-1": 160, "authenticationFailures": 0, "exceptions.multiResponseTooLarge": 0, "TotalCallTime_num_ops": 160, "TotalCallTime_min": 0, "TotalCallTime_max": 150, "TotalCallTime_mean": 4, "TotalCallTime_25th_percentile": 37, "TotalCallTime_median": 75, "TotalCallTime_75th_percentile": 112, "TotalCallTime_90th_percentile": 135, "TotalCallTime_95th_percentile": 142, "TotalCallTime_98th_percentile": 147, "TotalCallTime_99th_percentile": 148, "TotalCallTime_99.9th_percentile": 149, "TotalCallTime_TimeRangeCount_0-1": 160, "exceptions.RegionTooBusyException": 0, "exceptions.FailedSanityCheckException": 0, "ResponseSize_num_ops": 160, "ResponseSize_min": 0, "ResponseSize_max": 45021, "ResponseSize_mean": 1177, "ResponseSize_25th_percentile": 11255, "ResponseSize_median": 22510, "ResponseSize_75th_percentile": 33765, "ResponseSize_90th_percentile": 40518, "ResponseSize_95th_percentile": 42769, "ResponseSize_98th_percentile": 44120, "ResponseSize_99th_percentile": 44570, "ResponseSize_99.9th_percentile": 44975, "ResponseSize_SizeRangeCount_0-10": 160, "exceptions.UnknownScannerException": 0, "exceptions": 0, "authenticationFallbacks": 0, "exceptions.quotaExceeded": 0, "exceptions.NotServingRegionException": 0, "authorizationSuccesses": 0, "exceptions.ScannerResetException": 0, "RequestSize_num_ops": 160, "RequestSize_min": 39, "RequestSize_max": 508069, "RequestSize_mean": 9168, "RequestSize_25th_percentile": 127046, "RequestSize_median": 254054, "RequestSize_75th_percentile": 381061, "RequestSize_90th_percentile": 457266, "RequestSize_95th_percentile": 482667, "RequestSize_98th_percentile": 497908, "RequestSize_99th_percentile": 502988, "RequestSize_99.9th_percentile": 507560, "RequestSize_SizeRangeCount_0-10": 160, "sentBytes": 189792 } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Replication", "modelerType": "RegionServer,sub=Replication", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase17.apache.org", "source.shippedHFiles": 0, "Source.ageOfLastShippedOp_num_ops": 0, "Source.ageOfLastShippedOp_min": 0, "Source.ageOfLastShippedOp_max": 0, "Source.ageOfLastShippedOp_mean": 0, "Source.ageOfLastShippedOp_25th_percentile": 0, "Source.ageOfLastShippedOp_median": 0, "Source.ageOfLastShippedOp_75th_percentile": 0, "Source.ageOfLastShippedOp_90th_percentile": 0, "Source.ageOfLastShippedOp_95th_percentile": 0, "Source.ageOfLastShippedOp_98th_percentile": 0, "Source.ageOfLastShippedOp_99th_percentile": 0, "Source.ageOfLastShippedOp_99.9th_percentile": 0, "source.uncleanlyClosedLogs": 0, "source.closedLogsWithUnknownFileLength": 0, "source.walReaderEditsBufferUsage": 0, "source.repeatedLogFileBytes": 0, "source.shippedKBs": 0, "source.sizeOfHFileRefsQueue": 0, "source.logReadInBytes": 0, "source.completedRecoverQueues": 0, "source.sizeOfLogQueue": 0, "source.restartedLogReading": 0, "source.failedRecoverQueues": 0, "source.ignoredUncleanlyClosedLogContentsInBytes": 0, "Sink.ageOfLastAppliedOp_num_ops": 0, "Sink.ageOfLastAppliedOp_min": 0, "Sink.ageOfLastAppliedOp_max": 0, "Sink.ageOfLastAppliedOp_mean": 0, "Sink.ageOfLastAppliedOp_25th_percentile": 0, "Sink.ageOfLastAppliedOp_median": 0, "Sink.ageOfLastAppliedOp_75th_percentile": 0, "Sink.ageOfLastAppliedOp_90th_percentile": 0, "Sink.ageOfLastAppliedOp_95th_percentile": 0, "Sink.ageOfLastAppliedOp_98th_percentile": 0, "Sink.ageOfLastAppliedOp_99th_percentile": 0, "Sink.ageOfLastAppliedOp_99.9th_percentile": 0, "source.logEditsRead": 0, "source.numInitializing": 0, "source.shippedOps": 0, "sink.appliedHFiles": 0, "source.logEditsFiltered": 0, "source.shippedBytes": 0, "sink.appliedOps": 0, "source.completedLogs": 0, "source.failedBatches": 0, "sink.failedBatches": 0, "source.shippedBatches": 0, "sink.appliedBatches": 0 } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Server", "modelerType": "RegionServer,sub=Server", "tag.zookeeperQuorum": "127.0.0.1:56143", "tag.serverName": "jenkins-hbase17.apache.org,34091,1689169089223", "tag.clusterId": "ab905a1d-97a1-4fe0-86f4-b99ed4f6259d", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase17.apache.org", "regionCount": 9, "storeCount": 27, "hlogFileCount": 1, "hlogFileSize": 0, "storeFileCount": 0, "maxStoreFileCount": 0, "memStoreSize": 0, "storeFileSize": 0, "maxStoreFileAge": 0, "minStoreFileAge": 0, "avgStoreFileAge": 0, "numReferenceFiles": 0, "regionServerStartTime": 1689169089223, "averageRegionSize": 0, "storeFileIndexSize": 0, "staticIndexSize": 0, "staticBloomSize": 0, "mutationsWithoutWALCount": 0, "mutationsWithoutWALSize": 0, "percentFilesLocal": 0.0, "percentFilesLocalSecondaryRegions": 0.0, "totalBytesRead": 0, "localBytesRead": 0, "shortCircuitBytesRead": 0, "zeroCopyBytesRead": 0, "splitQueueLength": 0, "compactionQueueLength": 0, "smallCompactionQueueLength": 0, "largeCompactionQueueLength": 0, "flushQueueLength": 0, "blockCacheFreeSize": 819803968, "blockCacheCount": 0, "blockCacheDataBlockCount": 0, "blockCacheSize": 601920, "blockCacheCountHitPercent": 0.0, "blockCacheExpressHitPercent": 0.0, "l1CacheSize": 601920, "l1CacheFreeSize": 819803968, "l1CacheCount": 0, "l1CacheEvictionCount": 0, "l1CacheHitCount": 0, "l1CacheMissCount": 0, "l1CacheHitRatio": 0.0, "l1CacheMissRatio": 0.0, "l2CacheSize": 0, "l2CacheFreeSize": 0, "l2CacheCount": 0, "l2CacheEvictionCount": 0, "l2CacheHitCount": 0, "l2CacheMissCount": 0, "l2CacheHitRatio": 0.0, "l2CacheMissRatio": 0.0, "mobFileCacheCount": 0, "mobFileCacheHitPercent": 0.0, "readRequestRatePerSecond": 0.0, "writeRequestRatePerSecond": 0.0, "ByteBuffAllocatorHeapAllocationBytes": 0, "ByteBuffAllocatorPoolAllocationBytes": 0, "ByteBuffAllocatorHeapAllocationRatio": 0.0, "ByteBuffAllocatorTotalBufferCount": 186, "ByteBuffAllocatorUsedBufferCount": 0, "totalRequestCount": 1, "totalRowActionRequestCount": 0, "readRequestCount": 0, "filteredReadRequestCount": 0, "writeRequestCount": 0, "rpcGetRequestCount": 0, "rpcFullScanRequestCount": 0, "rpcScanRequestCount": 0, "rpcMultiRequestCount": 1, "rpcMutateRequestCount": 0, "checkMutateFailedCount": 0, "checkMutatePassedCount": 0, "blockCacheHitCount": 0, "blockCacheHitCountPrimary": 0, "blockCacheHitCachingCount": 0, "blockCacheMissCount": 0, "blockCacheMissCountPrimary": 0, "blockCacheMissCachingCount": 0, "blockCacheEvictionCount": 0, "blockCacheEvictionCountPrimary": 0, "blockCacheFailedInsertionCount": 0, "blockCacheDataMissCount": 0, "blockCacheLeafIndexMissCount": 0, "blockCacheBloomChunkMissCount": 0, "blockCacheMetaMissCount": 0, "blockCacheRootIndexMissCount": 0, "blockCacheIntermediateIndexMissCount": 0, "blockCacheFileInfoMissCount": 0, "blockCacheGeneralBloomMetaMissCount": 0, "blockCacheDeleteFamilyBloomMissCount": 0, "blockCacheTrailerMissCount": 0, "blockCacheDataHitCount": 0, "blockCacheLeafIndexHitCount": 0, "blockCacheBloomChunkHitCount": 0, "blockCacheMetaHitCount": 0, "blockCacheRootIndexHitCount": 0, "blockCacheIntermediateIndexHitCount": 0, "blockCacheFileInfoHitCount": 0, "blockCacheGeneralBloomMetaHitCount": 0, "blockCacheDeleteFamilyBloomHitCount": 0, "blockCacheTrailerHitCount": 0, "updatesBlockedTime": 0, "flushedCellsCount": 0, "compactedCellsCount": 0, "majorCompactedCellsCount": 0, "flushedCellsSize": 0, "compactedCellsSize": 0, "majorCompactedCellsSize": 0, "cellsCountCompactedFromMob": 0, "cellsCountCompactedToMob": 0, "cellsSizeCompactedFromMob": 0, "cellsSizeCompactedToMob": 0, "mobFlushCount": 0, "mobFlushedCellsCount": 0, "mobFlushedCellsSize": 0, "mobScanCellsCount": 0, "mobScanCellsSize": 0, "mobFileCacheAccessCount": 0, "mobFileCacheMissCount": 0, "mobFileCacheEvictedCount": 0, "hedgedReads": 0, "hedgedReadWins": 0, "hedgedReadOpsInCurThread": 0, "blockedRequestCount": 0, "CheckAndMutate_num_ops": 0, "CheckAndMutate_min": 0, "CheckAndMutate_max": 0, "CheckAndMutate_mean": 0, "CheckAndMutate_25th_percentile": 0, "CheckAndMutate_median": 0, "CheckAndMutate_75th_percentile": 0, "CheckAndMutate_90th_percentile": 0, "CheckAndMutate_95th_percentile": 0, "CheckAndMutate_98th_percentile": 0, "CheckAndMutate_99th_percentile": 0, "CheckAndMutate_99.9th_percentile": 0, "MajorCompactionTime_num_ops": 0, "MajorCompactionTime_min": 0, "MajorCompactionTime_max": 0, "MajorCompactionTime_mean": 0, "MajorCompactionTime_25th_percentile": 0, "MajorCompactionTime_median": 0, "MajorCompactionTime_75th_percentile": 0, "MajorCompactionTime_90th_percentile": 0, "MajorCompactionTime_95th_percentile": 0, "MajorCompactionTime_98th_percentile": 0, "MajorCompactionTime_99th_percentile": 0, "MajorCompactionTime_99.9th_percentile": 0, "PauseTimeWithGc_num_ops": 0, "PauseTimeWithGc_min": 0, "PauseTimeWithGc_max": 0, "PauseTimeWithGc_mean": 0, "PauseTimeWithGc_25th_percentile": 0, "PauseTimeWithGc_median": 0, "PauseTimeWithGc_75th_percentile": 0, "PauseTimeWithGc_90th_percentile": 0, "PauseTimeWithGc_95th_percentile": 0, "PauseTimeWithGc_98th_percentile": 0, "PauseTimeWithGc_99th_percentile": 0, "PauseTimeWithGc_99.9th_percentile": 0, "compactedOutputBytes": 0, "pauseWarnThresholdExceeded": 0, "ScanTime_num_ops": 0, "ScanTime_min": 0, "ScanTime_max": 0, "ScanTime_mean": 0, "ScanTime_25th_percentile": 0, "ScanTime_median": 0, "ScanTime_75th_percentile": 0, "ScanTime_90th_percentile": 0, "ScanTime_95th_percentile": 0, "ScanTime_98th_percentile": 0, "ScanTime_99th_percentile": 0, "ScanTime_99.9th_percentile": 0, "Increment_num_ops": 0, "Increment_min": 0, "Increment_max": 0, "Increment_mean": 0, "Increment_25th_percentile": 0, "Increment_median": 0, "Increment_75th_percentile": 0, "Increment_90th_percentile": 0, "Increment_95th_percentile": 0, "Increment_98th_percentile": 0, "Increment_99th_percentile": 0, "Increment_99.9th_percentile": 0, "Delete_num_ops": 0, "Delete_min": 0, "Delete_max": 0, "Delete_mean": 0, "Delete_25th_percentile": 0, "Delete_median": 0, "Delete_75th_percentile": 0, "Delete_90th_percentile": 0, "Delete_95th_percentile": 0, "Delete_98th_percentile": 0, "Delete_99th_percentile": 0, "Delete_99.9th_percentile": 0, "Put_num_ops": 0, "Put_min": 0, "Put_max": 0, "Put_mean": 0, "Put_25th_percentile": 0, "Put_median": 0, "Put_75th_percentile": 0, "Put_90th_percentile": 0, "Put_95th_percentile": 0, "Put_98th_percentile": 0, "Put_99th_percentile": 0, "Put_99.9th_percentile": 0, "DeleteBatch_num_ops": 0, "DeleteBatch_min": 0, "DeleteBatch_max": 0, "DeleteBatch_mean": 0, "DeleteBatch_25th_percentile": 0, "DeleteBatch_median": 0, "DeleteBatch_75th_percentile": 0, "DeleteBatch_90th_percentile": 0, "DeleteBatch_95th_percentile": 0, "DeleteBatch_98th_percentile": 0, "DeleteBatch_99th_percentile": 0, "DeleteBatch_99.9th_percentile": 0, "splitRequestCount": 0, "FlushMemstoreSize_num_ops": 0, "FlushMemstoreSize_min": 0, "FlushMemstoreSize_max": 0, "FlushMemstoreSize_mean": 0, "FlushMemstoreSize_25th_percentile": 0, "FlushMemstoreSize_median": 0, "FlushMemstoreSize_75th_percentile": 0, "FlushMemstoreSize_90th_percentile": 0, "FlushMemstoreSize_95th_percentile": 0, "FlushMemstoreSize_98th_percentile": 0, "FlushMemstoreSize_99th_percentile": 0, "FlushMemstoreSize_99.9th_percentile": 0, "CompactionInputFileCount_num_ops": 0, "CompactionInputFileCount_min": 0, "CompactionInputFileCount_max": 0, "CompactionInputFileCount_mean": 0, "CompactionInputFileCount_25th_percentile": 0, "CompactionInputFileCount_median": 0, "CompactionInputFileCount_75th_percentile": 0, "CompactionInputFileCount_90th_percentile": 0, "CompactionInputFileCount_95th_percentile": 0, "CompactionInputFileCount_98th_percentile": 0, "CompactionInputFileCount_99th_percentile": 0, "CompactionInputFileCount_99.9th_percentile": 0, "PutBatch_num_ops": 9, "PutBatch_min": 9, "PutBatch_max": 34, "PutBatch_mean": 15, "PutBatch_25th_percentile": 15, "PutBatch_median": 21, "PutBatch_75th_percentile": 27, "PutBatch_90th_percentile": 31, "PutBatch_95th_percentile": 32, "PutBatch_98th_percentile": 33, "PutBatch_99th_percentile": 33, "PutBatch_99.9th_percentile": 33, "PutBatch_TimeRangeCount_0-1": 9, "CompactionTime_num_ops": 0, "CompactionTime_min": 0, "CompactionTime_max": 0, "CompactionTime_mean": 0, "CompactionTime_25th_percentile": 0, "CompactionTime_median": 0, "CompactionTime_75th_percentile": 0, "CompactionTime_90th_percentile": 0, "CompactionTime_95th_percentile": 0, "CompactionTime_98th_percentile": 0, "CompactionTime_99th_percentile": 0, "CompactionTime_99.9th_percentile": 0, "Get_num_ops": 0, "Get_min": 0, "Get_max": 0, "Get_mean": 0, "Get_25th_percentile": 0, "Get_median": 0, "Get_75th_percentile": 0, "Get_90th_percentile": 0, "Get_95th_percentile": 0, "Get_98th_percentile": 0, "Get_99th_percentile": 0, "Get_99.9th_percentile": 0, "MajorCompactionInputFileCount_num_ops": 0, "MajorCompactionInputFileCount_min": 0, "MajorCompactionInputFileCount_max": 0, "MajorCompactionInputFileCount_mean": 0, "MajorCompactionInputFileCount_25th_percentile": 0, "MajorCompactionInputFileCount_median": 0, "MajorCompactionInputFileCount_75th_percentile": 0, "MajorCompactionInputFileCount_90th_percentile": 0, "MajorCompactionInputFileCount_95th_percentile": 0, "MajorCompactionInputFileCount_98th_percentile": 0, "MajorCompactionInputFileCount_99th_percentile": 0, "MajorCompactionInputFileCount_99.9th_percentile": 0, "CheckAndPut_num_ops": 0, "CheckAndPut_min": 0, "CheckAndPut_max": 0, "CheckAndPut_mean": 0, "CheckAndPut_25th_percentile": 0, "CheckAndPut_median": 0, "CheckAndPut_75th_percentile": 0, "CheckAndPut_90th_percentile": 0, "CheckAndPut_95th_percentile": 0, "CheckAndPut_98th_percentile": 0, "CheckAndPut_99th_percentile": 0, "CheckAndPut_99.9th_percentile": 0, "SplitTime_num_ops": 0, "SplitTime_min": 0, "SplitTime_max": 0, "SplitTime_mean": 0, "SplitTime_25th_percentile": 0, "SplitTime_median": 0, "SplitTime_75th_percentile": 0, "SplitTime_90th_percentile": 0, "SplitTime_95th_percentile": 0, "SplitTime_98th_percentile": 0, "SplitTime_99th_percentile": 0, "SplitTime_99.9th_percentile": 0, "MajorCompactionOutputSize_num_ops": 0, "MajorCompactionOutputSize_min": 0, "MajorCompactionOutputSize_max": 0, "MajorCompactionOutputSize_mean": 0, "MajorCompactionOutputSize_25th_percentile": 0, "MajorCompactionOutputSize_median": 0, "MajorCompactionOutputSize_75th_percentile": 0, "MajorCompactionOutputSize_90th_percentile": 0, "MajorCompactionOutputSize_95th_percentile": 0, "MajorCompactionOutputSize_98th_percentile": 0, "MajorCompactionOutputSize_99th_percentile": 0, "MajorCompactionOutputSize_99.9th_percentile": 0, "majorCompactedInputBytes": 0, "slowAppendCount": 0, "flushedOutputBytes": 0, "CompactionOutputFileCount_num_ops": 0, "CompactionOutputFileCount_min": 0, "CompactionOutputFileCount_max": 0, "CompactionOutputFileCount_mean": 0, "CompactionOutputFileCount_25th_percentile": 0, "CompactionOutputFileCount_median": 0, "CompactionOutputFileCount_75th_percentile": 0, "CompactionOutputFileCount_90th_percentile": 0, "CompactionOutputFileCount_95th_percentile": 0, "CompactionOutputFileCount_98th_percentile": 0, "CompactionOutputFileCount_99th_percentile": 0, "CompactionOutputFileCount_99.9th_percentile": 0, "slowDeleteCount": 0, "Replay_num_ops": 0, "Replay_min": 0, "Replay_max": 0, "Replay_mean": 0, "Replay_25th_percentile": 0, "Replay_median": 0, "Replay_75th_percentile": 0, "Replay_90th_percentile": 0, "Replay_95th_percentile": 0, "Replay_98th_percentile": 0, "Replay_99th_percentile": 0, "Replay_99.9th_percentile": 0, "FlushTime_num_ops": 0, "FlushTime_min": 0, "FlushTime_max": 0, "FlushTime_mean": 0, "FlushTime_25th_percentile": 0, "FlushTime_median": 0, "FlushTime_75th_percentile": 0, "FlushTime_90th_percentile": 0, "FlushTime_95th_percentile": 0, "FlushTime_98th_percentile": 0, "FlushTime_99th_percentile": 0, "FlushTime_99.9th_percentile": 0, "MajorCompactionInputSize_num_ops": 0, "MajorCompactionInputSize_min": 0, "MajorCompactionInputSize_max": 0, "MajorCompactionInputSize_mean": 0, "MajorCompactionInputSize_25th_percentile": 0, "MajorCompactionInputSize_median": 0, "MajorCompactionInputSize_75th_percentile": 0, "MajorCompactionInputSize_90th_percentile": 0, "MajorCompactionInputSize_95th_percentile": 0, "MajorCompactionInputSize_98th_percentile": 0, "MajorCompactionInputSize_99th_percentile": 0, "MajorCompactionInputSize_99.9th_percentile": 0, "pauseInfoThresholdExceeded": 0, "splitSuccessCount": 0, "CheckAndDelete_num_ops": 0, "CheckAndDelete_min": 0, "CheckAndDelete_max": 0, "CheckAndDelete_mean": 0, "CheckAndDelete_25th_percentile": 0, "CheckAndDelete_median": 0, "CheckAndDelete_75th_percentile": 0, "CheckAndDelete_90th_percentile": 0, "CheckAndDelete_95th_percentile": 0, "CheckAndDelete_98th_percentile": 0, "CheckAndDelete_99th_percentile": 0, "CheckAndDelete_99.9th_percentile": 0, "CompactionInputSize_num_ops": 0, "CompactionInputSize_min": 0, "CompactionInputSize_max": 0, "CompactionInputSize_mean": 0, "CompactionInputSize_25th_percentile": 0, "CompactionInputSize_median": 0, "CompactionInputSize_75th_percentile": 0, "CompactionInputSize_90th_percentile": 0, "CompactionInputSize_95th_percentile": 0, "CompactionInputSize_98th_percentile": 0, "CompactionInputSize_99th_percentile": 0, "CompactionInputSize_99.9th_percentile": 0, "MajorCompactionOutputFileCount_num_ops": 0, "MajorCompactionOutputFileCount_min": 0, "MajorCompactionOutputFileCount_max": 0, "MajorCompactionOutputFileCount_mean": 0, "MajorCompactionOutputFileCount_25th_percentile": 0, "MajorCompactionOutputFileCount_median": 0, "MajorCompactionOutputFileCount_75th_percentile": 0, "MajorCompactionOutputFileCount_90th_percentile": 0, "MajorCompactionOutputFileCount_95th_percentile": 0, "MajorCompactionOutputFileCount_98th_percentile": 0, "MajorCompactionOutputFileCount_99th_percentile": 0, "MajorCompactionOutputFileCount_99.9th_percentile": 0, "ScanSize_num_ops": 0, "ScanSize_min": 0, "ScanSize_max": 0, "ScanSize_mean": 0, "ScanSize_25th_percentile": 0, "ScanSize_median": 0, "ScanSize_75th_percentile": 0, "ScanSize_90th_percentile": 0, "ScanSize_95th_percentile": 0, "ScanSize_98th_percentile": 0, "ScanSize_99th_percentile": 0, "ScanSize_99.9th_percentile": 0, "slowGetCount": 0, "flushedMemstoreBytes": 0, "CompactionOutputSize_num_ops": 0, "CompactionOutputSize_min": 0, "CompactionOutputSize_max": 0, "CompactionOutputSize_mean": 0, "CompactionOutputSize_25th_percentile": 0, "CompactionOutputSize_median": 0, "CompactionOutputSize_75th_percentile": 0, "CompactionOutputSize_90th_percentile": 0, "CompactionOutputSize_95th_percentile": 0, "CompactionOutputSize_98th_percentile": 0, "CompactionOutputSize_99th_percentile": 0, "CompactionOutputSize_99.9th_percentile": 0, "majorCompactedOutputBytes": 0, "PauseTimeWithoutGc_num_ops": 0, "PauseTimeWithoutGc_min": 0, "PauseTimeWithoutGc_max": 0, "PauseTimeWithoutGc_mean": 0, "PauseTimeWithoutGc_25th_percentile": 0, "PauseTimeWithoutGc_median": 0, "PauseTimeWithoutGc_75th_percentile": 0, "PauseTimeWithoutGc_90th_percentile": 0, "PauseTimeWithoutGc_95th_percentile": 0, "PauseTimeWithoutGc_98th_percentile": 0, "PauseTimeWithoutGc_99th_percentile": 0, "PauseTimeWithoutGc_99.9th_percentile": 0, "slowPutCount": 0, "slowIncrementCount": 0, "compactedInputBytes": 0, "Append_num_ops": 0, "Append_min": 0, "Append_max": 0, "Append_mean": 0, "Append_25th_percentile": 0, "Append_median": 0, "Append_75th_percentile": 0, "Append_90th_percentile": 0, "Append_95th_percentile": 0, "Append_98th_percentile": 0, "Append_99th_percentile": 0, "Append_99.9th_percentile": 0, "FlushOutputSize_num_ops": 0, "FlushOutputSize_min": 0, "FlushOutputSize_max": 0, "FlushOutputSize_mean": 0, "FlushOutputSize_25th_percentile": 0, "FlushOutputSize_median": 0, "FlushOutputSize_75th_percentile": 0, "FlushOutputSize_90th_percentile": 0, "FlushOutputSize_95th_percentile": 0, "FlushOutputSize_98th_percentile": 0, "FlushOutputSize_99th_percentile": 0, "FlushOutputSize_99.9th_percentile": 0, "Bulkload_count": 0, "Bulkload_mean_rate": 0.0, "Bulkload_1min_rate": 0.0, "Bulkload_5min_rate": 0.0, "Bulkload_15min_rate": 0.0, "Bulkload_num_ops": 0, "Bulkload_min": 0, "Bulkload_max": 0, "Bulkload_mean": 0, "Bulkload_25th_percentile": 0, "Bulkload_median": 0, "Bulkload_75th_percentile": 0, "Bulkload_90th_percentile": 0, "Bulkload_95th_percentile": 0, "Bulkload_98th_percentile": 0, "Bulkload_99th_percentile": 0, "Bulkload_99.9th_percentile": 0, "ServerReadQueryPerSecond_count": 93, "ServerReadQueryPerSecond_mean_rate": 14.92471936646967, "ServerReadQueryPerSecond_1min_rate": 7.800000000000001, "ServerReadQueryPerSecond_5min_rate": 7.800000000000001, "ServerReadQueryPerSecond_15min_rate": 7.800000000000001, "ServerWriteQueryPerSecond_count": 17663, "ServerWriteQueryPerSecond_mean_rate": 2834.573185375105, "ServerWriteQueryPerSecond_1min_rate": 17.4, "ServerWriteQueryPerSecond_5min_rate": 17.4, "ServerWriteQueryPerSecond_15min_rate": 17.4 } ] } 2023-07-12 13:38:17,576 WARN [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42137] master.MasterRpcServices(612): jenkins-hbase17.apache.org,39081,1689169089182 reported a fatal error: ***** ABORTING region server jenkins-hbase17.apache.org,39081,1689169089182: Simulated kill ***** 2023-07-12 13:38:17,585 INFO [Listener at localhost.localdomain/40361] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,39081,1689169089182' ***** 2023-07-12 13:38:17,585 INFO [Listener at localhost.localdomain/40361] regionserver.HRegionServer(2311): STOPPED: Simulated kill 2023-07-12 13:38:17,585 INFO [Listener at localhost.localdomain/40361] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 13:38:17,592 INFO [RS:0;jenkins-hbase17:39081] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 13:38:17,592 INFO [RS:0;jenkins-hbase17:39081] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager abruptly. 2023-07-12 13:38:17,592 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 13:38:17,593 INFO [RS:0;jenkins-hbase17:39081] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager abruptly. 2023-07-12 13:38:17,596 DEBUG [RS:0;jenkins-hbase17:39081] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03afb92e to 127.0.0.1:56143 2023-07-12 13:38:17,596 DEBUG [RS:0;jenkins-hbase17:39081] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:38:17,651 DEBUG [RS:0;jenkins-hbase17:39081] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:38:17,652 INFO [RS:0;jenkins-hbase17:39081] regionserver.LeaseManager(133): Closed leases 2023-07-12 13:38:17,653 INFO [RS:0;jenkins-hbase17:39081] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:39081 2023-07-12 13:38:17,664 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:17,664 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:17,665 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,39081,1689169089182 2023-07-12 13:38:17,666 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:38:17,666 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:38:17,666 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:38:17,666 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:38:17,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:17,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:17,667 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,39081,1689169089182] 2023-07-12 13:38:17,668 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,39081,1689169089182; numProcessing=1 2023-07-12 13:38:17,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:17,669 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase17.apache.org,39081,1689169089182 znode expired, triggering replicatorRemoved event 2023-07-12 13:38:17,670 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 13:38:17,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:17,671 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase17.apache.org,39081,1689169089182 znode expired, triggering replicatorRemoved event 2023-07-12 13:38:17,671 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,39081,1689169089182 already deleted, retry=false 2023-07-12 13:38:17,671 INFO [RegionServerTracker-0] master.ServerManager(568): Processing expiration of jenkins-hbase17.apache.org,39081,1689169089182 on jenkins-hbase17.apache.org,42137,1689169087924 2023-07-12 13:38:17,679 DEBUG [RegionServerTracker-0] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:38:17,679 INFO [RegionServerTracker-0] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=62 for jenkins-hbase17.apache.org,39081,1689169089182 (carryingMeta=true) jenkins-hbase17.apache.org,39081,1689169089182/CRASHED/regionCount=10/lock=java.util.concurrent.locks.ReentrantReadWriteLock@77d66ac6[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-12 13:38:17,685 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:38:17,685 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 13:38:17,685 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:38:17,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 13:38:17,687 INFO [Listener at localhost.localdomain/40361] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 13:38:17,688 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 13:38:17,689 INFO [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility(454): Restart 0 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:38:17,690 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 13:38:17,691 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 13:38:17,691 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 13:38:17,700 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 13:38:17,700 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 13:38:17,701 ERROR [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-07-12 13:38:17,702 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 13:38:17,702 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 13:38:17,703 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 13:38:17,703 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 13:38:17,705 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-12 13:38:17,714 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[] 2023-07-12 13:38:17,716 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 13:38:17,718 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 13:38:17,718 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 13:38:17,719 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 13:38:17,721 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 13:38:17,724 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:38:17,724 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 13:38:17,725 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 19 msec 2023-07-12 13:38:17,771 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:38:17,771 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:39081-0x10159c043900001, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:38:17,772 INFO [RS:0;jenkins-hbase17:39081] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,39081,1689169089182; zookeeper connection closed. 2023-07-12 13:38:17,788 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@46f04dd0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@46f04dd0 2023-07-12 13:38:17,789 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 13:38:17,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:17,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:38:17,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:17,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:38:17,793 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase17.apache.org,39081,1689169089182, table=hbase:meta, region=1588230740 2023-07-12 13:38:17,820 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689169127820 2023-07-12 13:38:17,820 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 13:38:17,837 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:38:17,838 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 13:38:17,839 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:17,840 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:38:17,841 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true, isMeta: true 2023-07-12 13:38:17,851 DEBUG [PEWorker-1] master.MasterWalManager(318): Renamed region directory: hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting 2023-07-12 13:38:17,868 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase17.apache.org,39081,1689169089182 WAL count=1, meta=true 2023-07-12 13:38:17,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta}] 2023-07-12 13:38:17,873 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 13:38:17,873 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:38:17,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 13:38:17,875 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 13:38:17,972 DEBUG [hconnection-0x639efd03-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:38:18,120 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 13:38:18,121 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 13:38:18,175 DEBUG [hconnection-0x639efd03-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:38:18,477 DEBUG [hconnection-0x639efd03-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:38:18,981 DEBUG [hconnection-0x639efd03-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:38:19,991 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:19,992 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:38:22,011 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:22,012 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:38:22,013 DEBUG [hconnection-0x639efd03-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4176 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:26,051 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:26,052 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:38:26,052 DEBUG [hconnection-0x639efd03-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8216 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:36,075 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:36,077 DEBUG [hconnection-0x639efd03-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18240 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:36,077 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:38:46,159 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:46,160 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:38:46,162 DEBUG [hconnection-0x639efd03-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28326 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:52,446 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase17.apache.org,39081,1689169089182 already deleted, retry=false 2023-07-12 13:38:56,187 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:38:56,188 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:38:56,189 DEBUG [hconnection-0x639efd03-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38352 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:06,208 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:06,209 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:39:06,209 DEBUG [hconnection-0x639efd03-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48373 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:06,210 DEBUG [Listener at localhost.localdomain/40361] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68389: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68389: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:06,211 WARN [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-12T13:39:06.211Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68389: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68389: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:06,212 INFO [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility(454): Restart 1 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:39:06,212 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 13:39:06,212 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 13:39:06,213 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 13:39:06,213 ERROR [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 13:39:06,213 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 13:39:06,213 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 13:39:06,213 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 13:39:06,213 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 13:39:06,218 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 4 msec 2023-07-12 13:39:06,220 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0] 2023-07-12 13:39:06,221 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 13:39:06,222 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 13:39:06,222 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 13:39:06,222 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 13:39:06,224 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 13:39:06,224 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:39:06,224 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 13:39:06,224 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 6 msec 2023-07-12 13:39:06,227 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 13:39:06,227 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase17.apache.org,39081,1689169089182, table=hbase:meta, region=1588230740 2023-07-12 13:39:06,228 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689169176228 2023-07-12 13:39:06,229 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 13:39:06,229 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true, isMeta: true 2023-07-12 13:39:06,232 DEBUG [hconnection-0x639efd03-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:39:06,234 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase17.apache.org,39081,1689169089182 WAL count=1, meta=true 2023-07-12 13:39:06,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta}] 2023-07-12 13:39:06,234 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 13:39:06,242 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:39:06,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=64, ppid=63, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:39:06,336 DEBUG [hconnection-0x639efd03-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:39:06,411 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35445] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=64 2023-07-12 13:39:06,450 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] wal.WALSplitter(300): Splitting hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, size=55.0 K (56310bytes) 2023-07-12 13:39:06,451 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta 2023-07-12 13:39:06,457 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta after 6ms 2023-07-12 13:39:06,473 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] wal.WALSplitter(311): Open hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta took 25ms 2023-07-12 13:39:06,491 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] wal.WALSplitter(346): Last flushed sequenceid for 1588230740: last_flushed_sequence_id: 18446744073709551615 2023-07-12 13:39:06,500 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] wal.WALSplitter(400): Finishing writing output for hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta so closing down 2023-07-12 13:39:06,500 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-12 13:39:06,509 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0-Writer-2] util.CommonFSUtils$DfsBuilderUtility(753): Could not find replicate method on builder; will not set replicate when creating output stream java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DistributedFileSystem$HdfsDataOutputStreamBuilder.replicate() at java.lang.Class.getMethod(Class.java:1786) at org.apache.hadoop.hbase.util.CommonFSUtils$DfsBuilderUtility.(CommonFSUtils.java:750) at org.apache.hadoop.hbase.util.CommonFSUtils.createForWal(CommonFSUtils.java:802) at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter.initOutput(ProtobufLogWriter.java:102) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:78) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.createRecoveredEditsWriter(WALFactory.java:402) at org.apache.hadoop.hbase.wal.WALSplitter.createWriter(WALSplitter.java:516) at org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink.createRecoveredEditsWriter(AbstractRecoveredEditsOutputSink.java:69) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.getRecoveredEditsWriter(RecoveredEditsOutputSink.java:81) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.append(RecoveredEditsOutputSink.java:63) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.writeBuffer(OutputSink.java:249) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.doRun(OutputSink.java:241) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.run(OutputSink.java:211) 2023-07-12 13:39:06,516 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta.temp 2023-07-12 13:39:06,520 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] wal.OutputSink(146): 3 split writer threads finished 2023-07-12 13:39:06,541 DEBUG [hconnection-0x639efd03-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:39:06,550 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta.temp (wrote 60 edits, skipped 0 edits in 2 ms) 2023-07-12 13:39:06,552 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 13:39:06,553 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] wal.WALSplitter(423): Processed 61 edits across 1 Regions in 75 ms; skipped=1; WAL=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, size=55.0 K, length=56310, corrupted=false, cancelled=false 2023-07-12 13:39:06,553 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] wal.WALSplitter(426): Completed split of hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, journal: Splitting hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, size=55.0 K (56310bytes) at 1689169146450Finishing writing output for hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta so closing down at 1689169146500 (+50 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta.temp at 1689169146517 (+17 ms)3 split writer threads finished at 1689169146520 (+3 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta.temp (wrote 60 edits, skipped 0 edits in 2 ms) at 1689169146550 (+30 ms)Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 at 1689169146552 (+2 ms)Processed 61 edits across 1 Regions in 75 ms; skipped=1; WAL=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, size=55.0 K, length=56310, corrupted=false, cancelled=false at 1689169146553 (+1 ms) 2023-07-12 13:39:06,553 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta 2023-07-12 13:39:06,555 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=64 2023-07-12 13:39:06,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] master.HMaster(3641): Remote procedure done, pid=64 2023-07-12 13:39:06,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] wal.WALSplitUtil(141): Moved hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/oldWALs 2023-07-12 13:39:06,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=64, resume processing ppid=63 2023-07-12 13:39:06,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 in 324 msec 2023-07-12 13:39:06,571 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:39:06,575 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=62 2023-07-12 13:39:06,575 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 in 338 msec 2023-07-12 13:39:06,577 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting dir is empty, no logs to split. 2023-07-12 13:39:06,577 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase17.apache.org,39081,1689169089182 WAL count=0, meta=true 2023-07-12 13:39:06,577 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase17.apache.org,39081,1689169089182 WAL splitting is done? wals=0, meta=true 2023-07-12 13:39:06,577 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 13:39:06,578 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:39:06,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 13:39:06,578 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 13:39:06,845 DEBUG [hconnection-0x639efd03-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:39:07,348 DEBUG [hconnection-0x639efd03-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:39:08,351 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:08,352 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:39:10,371 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:10,373 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:39:10,373 DEBUG [hconnection-0x639efd03-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4142 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:14,385 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:14,386 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:39:14,386 DEBUG [hconnection-0x639efd03-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8155 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:14,762 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase17.apache.org,39081,1689169089182 already deleted, retry=false 2023-07-12 13:39:24,450 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:24,451 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:39:24,451 DEBUG [hconnection-0x639efd03-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18220 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:34,455 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:34,456 DEBUG [hconnection-0x639efd03-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28225 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:34,456 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:39:44,486 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:44,486 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:39:44,487 DEBUG [hconnection-0x639efd03-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38256 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:54,582 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:54,583 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:39:54,583 DEBUG [hconnection-0x639efd03-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48352 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:54,584 DEBUG [Listener at localhost.localdomain/40361] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68539: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68539: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:54,585 WARN [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-12T13:39:54.584Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68539: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68539: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:54,585 INFO [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility(454): Restart 2 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:39:54,585 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 13:39:54,585 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 13:39:54,585 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 13:39:54,585 ERROR [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 13:39:54,585 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 13:39:54,585 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 13:39:54,585 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 13:39:54,586 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 13:39:54,592 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 6 msec 2023-07-12 13:39:54,594 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1] 2023-07-12 13:39:54,594 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 13:39:54,594 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 13:39:54,595 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 13:39:54,595 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 13:39:54,595 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 13:39:54,595 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 13:39:54,596 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 13:39:54,597 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:39:54,597 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:39:54,597 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:39:54,597 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 13:39:54,597 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:39:54,597 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:39:54,597 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 4 msec 2023-07-12 13:39:54,598 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 13:39:54,598 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase17.apache.org,39081,1689169089182, table=hbase:meta, region=1588230740 2023-07-12 13:39:54,598 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689169224598 2023-07-12 13:39:54,599 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 13:39:54,602 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting dir is empty, no logs to split. 2023-07-12 13:39:54,602 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase17.apache.org,39081,1689169089182 WAL count=0, meta=true 2023-07-12 13:39:54,602 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase17.apache.org,39081,1689169089182 WAL splitting is done? wals=0, meta=true 2023-07-12 13:39:54,602 DEBUG [hconnection-0x639efd03-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:39:54,602 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 13:39:54,603 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 13:39:54,604 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 13:39:54,604 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:39:54,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 13:39:54,604 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 13:39:54,703 DEBUG [hconnection-0x639efd03-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:39:54,905 DEBUG [hconnection-0x639efd03-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:39:55,207 DEBUG [hconnection-0x639efd03-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:39:55,710 DEBUG [hconnection-0x639efd03-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:39:56,718 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:56,719 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:39:58,722 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:39:58,723 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:39:58,723 DEBUG [hconnection-0x639efd03-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4121 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:02,735 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:02,736 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:40:02,736 DEBUG [hconnection-0x639efd03-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8134 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:10,691 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-07-12 13:40:12,779 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:12,783 DEBUG [hconnection-0x639efd03-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18180 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:12,783 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:40:22,816 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:22,819 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:40:22,819 DEBUG [hconnection-0x639efd03-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28217 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:32,850 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:32,851 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:40:32,851 DEBUG [hconnection-0x639efd03-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38249 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:42,908 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:42,910 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:40:42,910 DEBUG [hconnection-0x639efd03-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48308 ms ago, cancelled=false, msg=Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:42,911 DEBUG [Listener at localhost.localdomain/40361] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68372: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68372: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:42,913 WARN [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-12T13:40:42.912Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68372: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68372: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase17.apache.org,39081,1689169089182, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase17.apache.org/136.243.18.41:39081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:42,913 INFO [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility(454): Restart 3 exec state=pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:42,914 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 13:40:42,914 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 13:40:42,914 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 13:40:42,914 ERROR [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 13:40:42,914 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 13:40:42,914 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 13:40:42,915 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 13:40:42,915 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 13:40:42,917 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 13:40:42,919 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7] 2023-07-12 13:40:42,919 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 13:40:42,919 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 13:40:42,920 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 13:40:42,920 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 13:40:42,921 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 13:40:42,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 13:40:42,923 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 13:40:42,923 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:42,923 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:42,923 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:42,924 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 13:40:42,924 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:42,924 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:42,924 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 7 msec 2023-07-12 13:40:42,924 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 13:40:42,925 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase17.apache.org,39081,1689169089182, table=hbase:meta, region=1588230740 2023-07-12 13:40:42,925 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689169272925 2023-07-12 13:40:42,926 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 13:40:42,926 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 13:40:42,926 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 13:40:42,927 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 13:40:42,928 DEBUG [hconnection-0x639efd03-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:40:42,928 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 13:40:43,031 DEBUG [hconnection-0x639efd03-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:40:43,078 DEBUG [jenkins-hbase17:42137] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-07-12 13:40:43,079 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 13:40:43,079 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 13:40:43,079 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 13:40:43,079 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 13:40:43,080 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,35445,1689169089256, state=OPENING 2023-07-12 13:40:43,082 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 13:40:43,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:40:43,082 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 13:40:43,240 WARN [ReadOnlyZKClient-127.0.0.1:56143@0x53bcf140] client.ZKConnectionRegistry(168): Meta region is in state OPENING 2023-07-12 13:40:43,244 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:40:43,244 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35445] ipc.CallRunner(144): callId: 143 service: ClientService methodName: Scan size: 97 connection: 136.243.18.41:59802 deadline: 1689169302932, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:43,246 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 13:40:43,246 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 13:40:43,248 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35445%2C1689169089256.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,35445,1689169089256, archiveDir=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/oldWALs, maxLogs=32 2023-07-12 13:40:43,265 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK] 2023-07-12 13:40:43,266 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK] 2023-07-12 13:40:43,268 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK] 2023-07-12 13:40:43,273 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,35445,1689169089256/jenkins-hbase17.apache.org%2C35445%2C1689169089256.meta.1689169243249.meta 2023-07-12 13:40:43,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46487,DS-2bb4ad98-4782-4532-b2a3-2fe0496a68f0,DISK], DatanodeInfoWithStorage[127.0.0.1:41091,DS-2b7995a9-3594-4f04-bb0a-ecd3ebcbf5b8,DISK], DatanodeInfoWithStorage[127.0.0.1:44153,DS-bf1c95dd-3d3e-46a6-a027-8182c22484ae,DISK]] 2023-07-12 13:40:43,274 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 13:40:43,274 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 13:40:43,274 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 13:40:43,275 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 13:40:43,275 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 13:40:43,275 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:40:43,275 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 13:40:43,275 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 13:40:43,277 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 13:40:43,278 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/info 2023-07-12 13:40:43,278 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/info 2023-07-12 13:40:43,279 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 13:40:43,281 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:43,281 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 13:40:43,283 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/rep_barrier 2023-07-12 13:40:43,283 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/rep_barrier 2023-07-12 13:40:43,283 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 13:40:43,284 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:43,284 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 13:40:43,286 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/table 2023-07-12 13:40:43,286 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/table 2023-07-12 13:40:43,286 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 13:40:43,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:43,288 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740 2023-07-12 13:40:43,290 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740 2023-07-12 13:40:43,291 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 13:40:43,304 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5464): Applied 274, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=63, path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 13:40:43,305 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=51.48 KB heapSize=72.27 KB 2023-07-12 13:40:43,372 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=51.19 KB at sequenceid=63 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/.tmp/info/d44da333dae84132b48d5fa4b92ace46 2023-07-12 13:40:43,436 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=296 B at sequenceid=63 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/.tmp/table/46c6afce5bf445f8b80f8a987077c1cd 2023-07-12 13:40:43,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/.tmp/info/d44da333dae84132b48d5fa4b92ace46 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/info/d44da333dae84132b48d5fa4b92ace46 2023-07-12 13:40:43,454 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/info/d44da333dae84132b48d5fa4b92ace46, entries=270, sequenceid=63, filesize=57.3 K 2023-07-12 13:40:43,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/.tmp/table/46c6afce5bf445f8b80f8a987077c1cd as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/table/46c6afce5bf445f8b80f8a987077c1cd 2023-07-12 13:40:43,462 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/table/46c6afce5bf445f8b80f8a987077c1cd, entries=4, sequenceid=63, filesize=4.9 K 2023-07-12 13:40:43,462 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~51.48 KB/52718, heapSize ~71.99 KB/73720, currentSize=0 B/0 for 1588230740 in 157ms, sequenceid=63, compaction requested=false; wal=null 2023-07-12 13:40:43,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-12 13:40:43,467 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:40:43,469 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 13:40:43,471 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/63.seqid, newMaxSeqId=63, maxSeqId=1 2023-07-12 13:40:43,472 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=64; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59696311, jitterRate=-0.11045564711093903}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:40:43,472 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 13:40:43,473 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=66, masterSystemTime=1689169243235 2023-07-12 13:40:43,474 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 13:40:43,475 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 13:40:43,475 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,35445,1689169089256, state=OPEN 2023-07-12 13:40:43,476 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 13:40:43,476 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 13:40:43,478 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-07-12 13:40:43,478 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256 in 394 msec 2023-07-12 13:40:43,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=65, resume processing ppid=62 2023-07-12 13:40:43,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 552 msec 2023-07-12 13:40:43,584 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e303901740e4d02964c49fa9d2b7f856, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,584 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=ec05a52723edbecd7be77f36806caa8a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,585 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=216faae9d032640dca24ddf65ab9f909, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,585 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5140a4a30c94e149363cee692772d310, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,585 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=221aa1ce383e614c344b914ded3151c4, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,585 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e3b643504d1d8a33902c66ba6c8a69fd, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,586 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=555ad7ad110af9ec101b9dfc5a07fa5c, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,586 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=92478ee2b34576368e173be7ee67f2a5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,586 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=260e260b05fbc83a4eb4ced4fbf3a9d8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,586 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=912c554550dbcecd943b5e17bf1b23fc, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,587 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=0bad15f8b77a93491f41e70639dc1fc8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,587 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fd43ad19523fd1e39bad44724f1ef3da, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,587 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=f9e1981fea95432fc8fb92eb7cc4524d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,587 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=674f5b2fb0eacd68f031d75fb1103b80, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,588 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4d1dc6d5e0bd7eff97daa4fe943dbce7, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,588 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fa76a2771db04ba3b6a7d1be4a08daf8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,588 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=b38842d7461fd90c4f30b3afd99f11b8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,588 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4641e91601e8baa52f8f326a3d617a38, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,589 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=a623158b89e27dff4b3c43e771d2b672, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,589 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5c50497f7f74f39b808201e941fd8963, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,589 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=20ad56ffb65cb5bab6d1f89dc701d381, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,589 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=06b18c3992cc931e8054a4dcc480ece1, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,590 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=6deb0a5007b6ff006e3a4a9f7e3b5f3d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,590 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=c4e74d3136130f438093e2507612b0b5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,590 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=736207afd3173343fa3290362bfa994d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,590 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=98e8c1a65ac96e53d5bdaf4943cf497a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,591 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=19ef6586ee290d893dc86ad8b10dd468, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,591 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 13:40:43,591 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689169303591 2023-07-12 13:40:43,591 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689169363591 2023-07-12 13:40:43,591 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1536): Joined the cluster in 665 msec 2023-07-12 13:40:43,592 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase17.apache.org,39081,1689169089182 had 10 regions 2023-07-12 13:40:43,592 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 13:40:43,592 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:43,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 13:40:43,592 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 13:40:43,841 INFO [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility(454): Restart 4 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:43,842 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 13:40:43,842 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 13:40:43,842 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 13:40:43,842 ERROR [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 13:40:43,842 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 13:40:43,842 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 13:40:43,842 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 13:40:43,843 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 13:40:43,844 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 13:40:43,847 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14] 2023-07-12 13:40:43,847 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 13:40:43,847 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 13:40:43,847 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 13:40:43,848 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 13:40:43,848 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 13:40:43,849 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 13:40:43,849 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 13:40:43,850 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 13:40:43,851 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 13:40:43,853 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:43,854 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:43,854 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:43,854 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 13:40:43,854 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:43,854 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 13:40:43,854 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:43,855 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:43,855 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:43,855 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:43,855 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 10 msec 2023-07-12 13:40:43,856 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 13:40:43,857 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase17.apache.org,35445,1689169089256, table=hbase:meta, region=1588230740 2023-07-12 13:40:43,857 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689169273857 2023-07-12 13:40:43,858 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 13:40:43,865 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e303901740e4d02964c49fa9d2b7f856, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,865 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=ec05a52723edbecd7be77f36806caa8a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,866 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=216faae9d032640dca24ddf65ab9f909, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,866 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5140a4a30c94e149363cee692772d310, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,866 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=221aa1ce383e614c344b914ded3151c4, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,866 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e3b643504d1d8a33902c66ba6c8a69fd, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,866 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=555ad7ad110af9ec101b9dfc5a07fa5c, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,866 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=92478ee2b34576368e173be7ee67f2a5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,867 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=260e260b05fbc83a4eb4ced4fbf3a9d8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,867 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=912c554550dbcecd943b5e17bf1b23fc, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,867 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=0bad15f8b77a93491f41e70639dc1fc8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,867 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fd43ad19523fd1e39bad44724f1ef3da, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,867 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=f9e1981fea95432fc8fb92eb7cc4524d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,867 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=674f5b2fb0eacd68f031d75fb1103b80, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,867 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4d1dc6d5e0bd7eff97daa4fe943dbce7, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,867 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fa76a2771db04ba3b6a7d1be4a08daf8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,868 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=b38842d7461fd90c4f30b3afd99f11b8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,868 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4641e91601e8baa52f8f326a3d617a38, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,868 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=a623158b89e27dff4b3c43e771d2b672, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,868 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5c50497f7f74f39b808201e941fd8963, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,868 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=20ad56ffb65cb5bab6d1f89dc701d381, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,868 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=06b18c3992cc931e8054a4dcc480ece1, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,869 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=6deb0a5007b6ff006e3a4a9f7e3b5f3d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,869 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=c4e74d3136130f438093e2507612b0b5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,869 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=736207afd3173343fa3290362bfa994d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:43,869 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=98e8c1a65ac96e53d5bdaf4943cf497a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:43,869 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=19ef6586ee290d893dc86ad8b10dd468, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:43,869 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 13:40:43,869 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689169303869 2023-07-12 13:40:43,869 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689169363869 2023-07-12 13:40:43,869 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1536): Joined the cluster in 11 msec 2023-07-12 13:40:43,870 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase17.apache.org,39081,1689169089182 had 9 regions 2023-07-12 13:40:43,870 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 13:40:43,871 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true, isMeta: false 2023-07-12 13:40:43,873 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase17.apache.org,39081,1689169089182 WAL count=1, meta=false 2023-07-12 13:40:43,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851}] 2023-07-12 13:40:43,873 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 13:40:43,873 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:43,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 13:40:43,873 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 13:40:44,120 INFO [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility(454): Restart 5 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:44,120 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 13:40:44,120 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 13:40:44,120 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 13:40:44,120 ERROR [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 13:40:44,120 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 13:40:44,120 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 13:40:44,120 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 13:40:44,121 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 13:40:44,121 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 13:40:44,123 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16] 2023-07-12 13:40:44,123 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 13:40:44,123 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 13:40:44,123 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 13:40:44,123 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 13:40:44,123 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 13:40:44,124 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 13:40:44,124 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 13:40:44,124 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 13:40:44,125 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 13:40:44,125 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:44,125 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,126 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,126 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 13:40:44,126 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,126 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 13:40:44,126 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,126 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,126 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,126 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,126 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 4 msec 2023-07-12 13:40:44,127 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 13:40:44,128 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase17.apache.org,35445,1689169089256, table=hbase:meta, region=1588230740 2023-07-12 13:40:44,128 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689169274128 2023-07-12 13:40:44,129 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 13:40:44,134 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e303901740e4d02964c49fa9d2b7f856, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,135 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=ec05a52723edbecd7be77f36806caa8a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,135 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=216faae9d032640dca24ddf65ab9f909, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,135 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5140a4a30c94e149363cee692772d310, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,135 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=221aa1ce383e614c344b914ded3151c4, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,135 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e3b643504d1d8a33902c66ba6c8a69fd, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,136 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=555ad7ad110af9ec101b9dfc5a07fa5c, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,136 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=92478ee2b34576368e173be7ee67f2a5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,136 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=260e260b05fbc83a4eb4ced4fbf3a9d8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,136 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=912c554550dbcecd943b5e17bf1b23fc, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,136 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=0bad15f8b77a93491f41e70639dc1fc8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,136 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fd43ad19523fd1e39bad44724f1ef3da, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,137 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=f9e1981fea95432fc8fb92eb7cc4524d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,137 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=674f5b2fb0eacd68f031d75fb1103b80, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,137 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4d1dc6d5e0bd7eff97daa4fe943dbce7, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,137 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fa76a2771db04ba3b6a7d1be4a08daf8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,137 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=b38842d7461fd90c4f30b3afd99f11b8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,137 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4641e91601e8baa52f8f326a3d617a38, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,137 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=a623158b89e27dff4b3c43e771d2b672, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,138 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5c50497f7f74f39b808201e941fd8963, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,138 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=20ad56ffb65cb5bab6d1f89dc701d381, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,138 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=06b18c3992cc931e8054a4dcc480ece1, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,138 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=6deb0a5007b6ff006e3a4a9f7e3b5f3d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,138 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=c4e74d3136130f438093e2507612b0b5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,138 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=736207afd3173343fa3290362bfa994d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,138 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=98e8c1a65ac96e53d5bdaf4943cf497a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,139 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=19ef6586ee290d893dc86ad8b10dd468, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,139 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 13:40:44,139 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689169304139 2023-07-12 13:40:44,139 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689169364139 2023-07-12 13:40:44,139 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1536): Joined the cluster in 10 msec 2023-07-12 13:40:44,139 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true, isMeta: false 2023-07-12 13:40:44,141 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase17.apache.org,39081,1689169089182 WAL count=1, meta=false 2023-07-12 13:40:44,141 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851}] 2023-07-12 13:40:44,141 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 13:40:44,143 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:40:44,297 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35445] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=68 2023-07-12 13:40:44,314 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(300): Splitting hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, size=327.2 K (335044bytes) 2023-07-12 13:40:44,314 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851 2023-07-12 13:40:44,315 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851 after 1ms 2023-07-12 13:40:44,319 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(311): Open hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851 took 5ms 2023-07-12 13:40:44,322 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(346): Last flushed sequenceid for 674f5b2fb0eacd68f031d75fb1103b80: last_flushed_sequence_id: 18446744073709551615 2023-07-12 13:40:44,323 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(346): Last flushed sequenceid for 4d1dc6d5e0bd7eff97daa4fe943dbce7: last_flushed_sequence_id: 18446744073709551615 2023-07-12 13:40:44,323 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(346): Last flushed sequenceid for 0bad15f8b77a93491f41e70639dc1fc8: last_flushed_sequence_id: 18446744073709551615 2023-07-12 13:40:44,324 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(346): Last flushed sequenceid for 5140a4a30c94e149363cee692772d310: last_flushed_sequence_id: 18446744073709551615 2023-07-12 13:40:44,325 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(346): Last flushed sequenceid for 92478ee2b34576368e173be7ee67f2a5: last_flushed_sequence_id: 18446744073709551615 2023-07-12 13:40:44,326 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(346): Last flushed sequenceid for 221aa1ce383e614c344b914ded3151c4: last_flushed_sequence_id: 18446744073709551615 2023-07-12 13:40:44,327 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(346): Last flushed sequenceid for 4641e91601e8baa52f8f326a3d617a38: last_flushed_sequence_id: 18446744073709551615 2023-07-12 13:40:44,327 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(346): Last flushed sequenceid for 06b18c3992cc931e8054a4dcc480ece1: last_flushed_sequence_id: 18446744073709551615 2023-07-12 13:40:44,328 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(346): Last flushed sequenceid for 736207afd3173343fa3290362bfa994d: last_flushed_sequence_id: 18446744073709551615 2023-07-12 13:40:44,338 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp 2023-07-12 13:40:44,340 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp 2023-07-12 13:40:44,341 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp 2023-07-12 13:40:44,347 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp 2023-07-12 13:40:44,347 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp 2023-07-12 13:40:44,350 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(400): Finishing writing output for hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851 so closing down 2023-07-12 13:40:44,350 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp 2023-07-12 13:40:44,350 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-12 13:40:44,352 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp 2023-07-12 13:40:44,358 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp 2023-07-12 13:40:44,360 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp 2023-07-12 13:40:44,360 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.OutputSink(146): 3 split writer threads finished 2023-07-12 13:40:44,403 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 13:40:44,407 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/0000000000000000004 2023-07-12 13:40:44,409 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-12 13:40:44,409 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 13:40:44,411 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/0000000000000000004 2023-07-12 13:40:44,415 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/0000000000000000004 2023-07-12 13:40:44,445 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-12 13:40:44,446 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-12 13:40:44,447 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-12 13:40:44,448 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/0000000000000000004 2023-07-12 13:40:44,449 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/0000000000000000004 2023-07-12 13:40:44,451 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/0000000000000000004 2023-07-12 13:40:44,469 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 13:40:44,471 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/0000000000000000004 2023-07-12 13:40:44,475 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 13:40:44,478 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/0000000000000000004 2023-07-12 13:40:44,479 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-12 13:40:44,481 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/0000000000000000004 2023-07-12 13:40:44,481 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(423): Processed 18 edits across 9 Regions in 162 ms; skipped=9; WAL=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, size=327.2 K, length=335044, corrupted=false, cancelled=false 2023-07-12 13:40:44,481 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] wal.WALSplitter(426): Completed split of hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, journal: Splitting hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, size=327.2 K (335044bytes) at 1689169244314Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp at 1689169244338 (+24 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp at 1689169244341 (+3 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp at 1689169244341Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp at 1689169244347 (+6 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp at 1689169244347Split 8 edits, skipped 9 edits. at 1689169244348 (+1 ms)Finishing writing output for hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851 so closing down at 1689169244350 (+2 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp at 1689169244350Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp at 1689169244352 (+2 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp at 1689169244358 (+6 ms)Creating recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp at 1689169244360 (+2 ms)3 split writer threads finished at 1689169244360Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689169244403 (+43 ms)Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/0000000000000000004 at 1689169244407 (+4 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689169244409 (+2 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689169244409Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/0000000000000000004 at 1689169244411 (+2 ms)Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/0000000000000000004 at 1689169244416 (+5 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689169244445 (+29 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689169244446 (+1 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689169244447 (+1 ms)Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/0000000000000000004 at 1689169244448 (+1 ms)Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/0000000000000000004 at 1689169244449 (+1 ms)Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/0000000000000000004 at 1689169244452 (+3 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689169244470 (+18 ms)Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/0000000000000000004 at 1689169244471 (+1 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689169244475 (+4 ms)Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/0000000000000000004 at 1689169244479 (+4 ms)Closed recovered edits writer path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689169244479Rename recovered edits hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/0000000000000000004-jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851.temp to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/0000000000000000004 at 1689169244481 (+2 ms)Processed 18 edits across 9 Regions in 162 ms; skipped=9; WAL=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, size=327.2 K, length=335044, corrupted=false, cancelled=false at 1689169244481 2023-07-12 13:40:44,481 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851 2023-07-12 13:40:44,481 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0-1] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=68 2023-07-12 13:40:44,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] master.HMaster(3641): Remote procedure done, pid=68 2023-07-12 13:40:44,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42137] wal.WALSplitUtil(141): Moved hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting/jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851 to hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/oldWALs 2023-07-12 13:40:44,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-07-12 13:40:44,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 in 341 msec 2023-07-12 13:40:44,488 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=62 2023-07-12 13:40:44,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 in 347 msec 2023-07-12 13:40:44,491 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting dir is empty, no logs to split. 2023-07-12 13:40:44,491 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase17.apache.org,39081,1689169089182 WAL count=0, meta=false 2023-07-12 13:40:44,491 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase17.apache.org,39081,1689169089182 WAL splitting is done? wals=0, meta=false 2023-07-12 13:40:44,492 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 13:40:44,492 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:44,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 13:40:44,492 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 13:40:44,639 INFO [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility(454): Restart 6 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:44,639 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 13:40:44,639 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 13:40:44,640 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 13:40:44,641 ERROR [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 13:40:44,641 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 13:40:44,641 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 13:40:44,641 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 13:40:44,641 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 13:40:44,642 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 13:40:44,643 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18] 2023-07-12 13:40:44,644 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 13:40:44,644 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 13:40:44,644 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-12 13:40:44,644 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-12 13:40:44,644 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 13:40:44,644 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 13:40:44,645 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 13:40:44,645 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 13:40:44,645 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 13:40:44,645 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 13:40:44,646 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 13:40:44,647 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:44,647 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,648 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,648 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 13:40:44,648 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,648 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,648 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,648 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 13:40:44,648 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,648 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,648 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,649 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,649 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,649 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,649 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 6 msec 2023-07-12 13:40:44,650 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 13:40:44,650 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase17.apache.org,35445,1689169089256, table=hbase:meta, region=1588230740 2023-07-12 13:40:44,650 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689169274650 2023-07-12 13:40:44,651 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 13:40:44,655 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e303901740e4d02964c49fa9d2b7f856, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,656 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=ec05a52723edbecd7be77f36806caa8a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,656 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=216faae9d032640dca24ddf65ab9f909, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,656 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5140a4a30c94e149363cee692772d310, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,656 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=221aa1ce383e614c344b914ded3151c4, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,656 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e3b643504d1d8a33902c66ba6c8a69fd, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,656 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=555ad7ad110af9ec101b9dfc5a07fa5c, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,657 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=92478ee2b34576368e173be7ee67f2a5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,657 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=260e260b05fbc83a4eb4ced4fbf3a9d8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,657 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=912c554550dbcecd943b5e17bf1b23fc, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,657 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=0bad15f8b77a93491f41e70639dc1fc8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,657 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fd43ad19523fd1e39bad44724f1ef3da, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,657 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=f9e1981fea95432fc8fb92eb7cc4524d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,657 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=674f5b2fb0eacd68f031d75fb1103b80, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,658 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4d1dc6d5e0bd7eff97daa4fe943dbce7, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,658 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fa76a2771db04ba3b6a7d1be4a08daf8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,658 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=b38842d7461fd90c4f30b3afd99f11b8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,658 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4641e91601e8baa52f8f326a3d617a38, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,658 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=a623158b89e27dff4b3c43e771d2b672, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,658 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5c50497f7f74f39b808201e941fd8963, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,658 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=20ad56ffb65cb5bab6d1f89dc701d381, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,659 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=06b18c3992cc931e8054a4dcc480ece1, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,659 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=6deb0a5007b6ff006e3a4a9f7e3b5f3d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,659 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=c4e74d3136130f438093e2507612b0b5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,659 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=736207afd3173343fa3290362bfa994d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,659 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=98e8c1a65ac96e53d5bdaf4943cf497a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,659 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=19ef6586ee290d893dc86ad8b10dd468, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,659 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 13:40:44,659 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689169304659 2023-07-12 13:40:44,659 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689169364659 2023-07-12 13:40:44,659 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1536): Joined the cluster in 8 msec 2023-07-12 13:40:44,661 INFO [PEWorker-1] master.MasterWalManager(320): Log dir for server jenkins-hbase17.apache.org,39081,1689169089182 does not exist 2023-07-12 13:40:44,661 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase17.apache.org,39081,1689169089182 WAL count=0, meta=false 2023-07-12 13:40:44,661 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase17.apache.org,39081,1689169089182 WAL splitting is done? wals=0, meta=false 2023-07-12 13:40:44,662 INFO [PEWorker-1] procedure.ServerCrashProcedure(282): Remove WAL directory for jenkins-hbase17.apache.org,39081,1689169089182 failed, ignore...File hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/WALs/jenkins-hbase17.apache.org,39081,1689169089182-splitting does not exist. 2023-07-12 13:40:44,662 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 13:40:44,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4641e91601e8baa52f8f326a3d617a38, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=736207afd3173343fa3290362bfa994d, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4d1dc6d5e0bd7eff97daa4fe943dbce7, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=674f5b2fb0eacd68f031d75fb1103b80, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0bad15f8b77a93491f41e70639dc1fc8, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5140a4a30c94e149363cee692772d310, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=92478ee2b34576368e173be7ee67f2a5, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=221aa1ce383e614c344b914ded3151c4, ASSIGN}, {pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=06b18c3992cc931e8054a4dcc480ece1, ASSIGN}] 2023-07-12 13:40:44,663 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 13:40:44,663 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:44,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 13:40:44,663 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 13:40:44,910 INFO [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility(454): Restart 7 exec state=pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:44,910 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 13:40:44,910 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 13:40:44,910 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 13:40:44,911 ERROR [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 13:40:44,911 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 13:40:44,911 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 13:40:44,911 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 13:40:44,911 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 13:40:44,913 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 13:40:44,915 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25] 2023-07-12 13:40:44,915 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 13:40:44,915 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 13:40:44,915 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-12 13:40:44,915 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-12 13:40:44,915 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 13:40:44,916 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 13:40:44,916 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 13:40:44,917 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 13:40:44,917 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 13:40:44,918 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 13:40:44,920 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 13:40:44,921 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:44,921 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,922 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:44,923 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 9 msec 2023-07-12 13:40:44,923 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 13:40:44,924 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase17.apache.org,35445,1689169089256, table=hbase:meta, region=1588230740 2023-07-12 13:40:44,924 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689169274924 2023-07-12 13:40:44,925 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 13:40:44,930 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e303901740e4d02964c49fa9d2b7f856, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,930 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=ec05a52723edbecd7be77f36806caa8a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,930 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=216faae9d032640dca24ddf65ab9f909, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,930 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5140a4a30c94e149363cee692772d310, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,930 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=221aa1ce383e614c344b914ded3151c4, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,931 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e3b643504d1d8a33902c66ba6c8a69fd, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,931 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=555ad7ad110af9ec101b9dfc5a07fa5c, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,931 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=92478ee2b34576368e173be7ee67f2a5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,931 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=260e260b05fbc83a4eb4ced4fbf3a9d8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,931 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=912c554550dbcecd943b5e17bf1b23fc, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,931 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=0bad15f8b77a93491f41e70639dc1fc8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,931 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fd43ad19523fd1e39bad44724f1ef3da, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,932 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=f9e1981fea95432fc8fb92eb7cc4524d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,932 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=674f5b2fb0eacd68f031d75fb1103b80, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,932 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4d1dc6d5e0bd7eff97daa4fe943dbce7, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,932 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fa76a2771db04ba3b6a7d1be4a08daf8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,932 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=b38842d7461fd90c4f30b3afd99f11b8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,932 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4641e91601e8baa52f8f326a3d617a38, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,933 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=a623158b89e27dff4b3c43e771d2b672, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,933 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5c50497f7f74f39b808201e941fd8963, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,933 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=20ad56ffb65cb5bab6d1f89dc701d381, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,933 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=06b18c3992cc931e8054a4dcc480ece1, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,933 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=6deb0a5007b6ff006e3a4a9f7e3b5f3d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,933 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=c4e74d3136130f438093e2507612b0b5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,933 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=736207afd3173343fa3290362bfa994d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,39081,1689169089182, regionLocation=jenkins-hbase17.apache.org,39081,1689169089182, openSeqNum=2 2023-07-12 13:40:44,934 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=98e8c1a65ac96e53d5bdaf4943cf497a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:44,934 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=19ef6586ee290d893dc86ad8b10dd468, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:44,934 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 13:40:44,934 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689169304934 2023-07-12 13:40:44,934 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689169364934 2023-07-12 13:40:44,934 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1536): Joined the cluster in 8 msec 2023-07-12 13:40:44,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4641e91601e8baa52f8f326a3d617a38, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=736207afd3173343fa3290362bfa994d, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4d1dc6d5e0bd7eff97daa4fe943dbce7, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=674f5b2fb0eacd68f031d75fb1103b80, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0bad15f8b77a93491f41e70639dc1fc8, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5140a4a30c94e149363cee692772d310, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=92478ee2b34576368e173be7ee67f2a5, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=221aa1ce383e614c344b914ded3151c4, ASSIGN}, {pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=06b18c3992cc931e8054a4dcc480ece1, ASSIGN}] 2023-07-12 13:40:44,936 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 13:40:44,937 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=06b18c3992cc931e8054a4dcc480ece1, ASSIGN 2023-07-12 13:40:44,937 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=06b18c3992cc931e8054a4dcc480ece1, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 13:40:44,938 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=221aa1ce383e614c344b914ded3151c4, ASSIGN 2023-07-12 13:40:44,938 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=221aa1ce383e614c344b914ded3151c4, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 13:40:44,939 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=92478ee2b34576368e173be7ee67f2a5, ASSIGN 2023-07-12 13:40:44,939 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=92478ee2b34576368e173be7ee67f2a5, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 13:40:44,940 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5140a4a30c94e149363cee692772d310, ASSIGN 2023-07-12 13:40:44,940 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5140a4a30c94e149363cee692772d310, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 13:40:44,941 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0bad15f8b77a93491f41e70639dc1fc8, ASSIGN 2023-07-12 13:40:44,941 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0bad15f8b77a93491f41e70639dc1fc8, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 13:40:44,942 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=674f5b2fb0eacd68f031d75fb1103b80, ASSIGN 2023-07-12 13:40:44,942 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=674f5b2fb0eacd68f031d75fb1103b80, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 13:40:44,943 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4d1dc6d5e0bd7eff97daa4fe943dbce7, ASSIGN 2023-07-12 13:40:44,943 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4d1dc6d5e0bd7eff97daa4fe943dbce7, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 13:40:44,944 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=736207afd3173343fa3290362bfa994d, ASSIGN 2023-07-12 13:40:44,944 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=736207afd3173343fa3290362bfa994d, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 13:40:44,945 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4641e91601e8baa52f8f326a3d617a38, ASSIGN 2023-07-12 13:40:44,946 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4641e91601e8baa52f8f326a3d617a38, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 13:40:45,088 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 13:40:45,089 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 13:40:45,089 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 13:40:45,089 DEBUG [jenkins-hbase17:42137] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 13:40:45,097 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=736207afd3173343fa3290362bfa994d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:45,097 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245097"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169245097"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169245097"}]},"ts":"1689169245097"} 2023-07-12 13:40:45,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=78, ppid=70, state=RUNNABLE; OpenRegionProcedure 736207afd3173343fa3290362bfa994d, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:40:45,105 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=4641e91601e8baa52f8f326a3d617a38, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:45,105 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245105"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169245105"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169245105"}]},"ts":"1689169245105"} 2023-07-12 13:40:45,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=79, ppid=69, state=RUNNABLE; OpenRegionProcedure 4641e91601e8baa52f8f326a3d617a38, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:40:45,110 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=674f5b2fb0eacd68f031d75fb1103b80, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:45,110 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245110"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169245110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169245110"}]},"ts":"1689169245110"} 2023-07-12 13:40:45,112 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=72, state=RUNNABLE; OpenRegionProcedure 674f5b2fb0eacd68f031d75fb1103b80, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:40:45,114 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=92478ee2b34576368e173be7ee67f2a5, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:45,114 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245114"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169245114"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169245114"}]},"ts":"1689169245114"} 2023-07-12 13:40:45,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=75, state=RUNNABLE; OpenRegionProcedure 92478ee2b34576368e173be7ee67f2a5, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:40:45,119 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=5140a4a30c94e149363cee692772d310, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:45,119 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245119"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169245119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169245119"}]},"ts":"1689169245119"} 2023-07-12 13:40:45,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=74, state=RUNNABLE; OpenRegionProcedure 5140a4a30c94e149363cee692772d310, server=jenkins-hbase17.apache.org,35445,1689169089256}] 2023-07-12 13:40:45,122 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=77 updating hbase:meta row=06b18c3992cc931e8054a4dcc480ece1, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:45,122 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245122"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169245122"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169245122"}]},"ts":"1689169245122"} 2023-07-12 13:40:45,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=77, state=RUNNABLE; OpenRegionProcedure 06b18c3992cc931e8054a4dcc480ece1, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:40:45,125 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=4d1dc6d5e0bd7eff97daa4fe943dbce7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:45,126 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245125"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169245125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169245125"}]},"ts":"1689169245125"} 2023-07-12 13:40:45,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=71, state=RUNNABLE; OpenRegionProcedure 4d1dc6d5e0bd7eff97daa4fe943dbce7, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:40:45,129 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0bad15f8b77a93491f41e70639dc1fc8, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:45,129 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245129"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169245129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169245129"}]},"ts":"1689169245129"} 2023-07-12 13:40:45,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=73, state=RUNNABLE; OpenRegionProcedure 0bad15f8b77a93491f41e70639dc1fc8, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:40:45,132 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=221aa1ce383e614c344b914ded3151c4, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:45,132 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245132"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689169245132"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689169245132"}]},"ts":"1689169245132"} 2023-07-12 13:40:45,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=86, ppid=76, state=RUNNABLE; OpenRegionProcedure 221aa1ce383e614c344b914ded3151c4, server=jenkins-hbase17.apache.org,34091,1689169089223}] 2023-07-12 13:40:45,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:40:45,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 674f5b2fb0eacd68f031d75fb1103b80, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2023-07-12 13:40:45,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:40:45,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:40:45,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:40:45,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:40:45,264 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:40:45,266 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily11 2023-07-12 13:40:45,267 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily11 2023-07-12 13:40:45,267 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 674f5b2fb0eacd68f031d75fb1103b80 columnFamilyName colfamily11 2023-07-12 13:40:45,268 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(310): Store=674f5b2fb0eacd68f031d75fb1103b80/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,268 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:40:45,269 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily21 2023-07-12 13:40:45,269 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily21 2023-07-12 13:40:45,270 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 674f5b2fb0eacd68f031d75fb1103b80 columnFamilyName colfamily21 2023-07-12 13:40:45,270 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(310): Store=674f5b2fb0eacd68f031d75fb1103b80/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,271 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:40:45,272 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily31 2023-07-12 13:40:45,272 DEBUG [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily31 2023-07-12 13:40:45,272 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 674f5b2fb0eacd68f031d75fb1103b80 columnFamilyName colfamily31 2023-07-12 13:40:45,273 INFO [StoreOpener-674f5b2fb0eacd68f031d75fb1103b80-1] regionserver.HStore(310): Store=674f5b2fb0eacd68f031d75fb1103b80/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:40:45,276 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 13:40:45,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:40:45,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/0000000000000000004 2023-07-12 13:40:45,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:40:45,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bad15f8b77a93491f41e70639dc1fc8, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2023-07-12 13:40:45,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:40:45,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:40:45,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:40:45,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:40:45,284 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:40:45,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/0000000000000000004 2023-07-12 13:40:45,286 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily11 2023-07-12 13:40:45,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 674f5b2fb0eacd68f031d75fb1103b80 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:45,286 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily11 2023-07-12 13:40:45,286 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bad15f8b77a93491f41e70639dc1fc8 columnFamilyName colfamily11 2023-07-12 13:40:45,287 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(310): Store=0bad15f8b77a93491f41e70639dc1fc8/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,288 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:40:45,289 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily21 2023-07-12 13:40:45,289 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily21 2023-07-12 13:40:45,289 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bad15f8b77a93491f41e70639dc1fc8 columnFamilyName colfamily21 2023-07-12 13:40:45,290 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(310): Store=0bad15f8b77a93491f41e70639dc1fc8/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,290 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:40:45,291 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily31 2023-07-12 13:40:45,291 DEBUG [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily31 2023-07-12 13:40:45,291 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bad15f8b77a93491f41e70639dc1fc8 columnFamilyName colfamily31 2023-07-12 13:40:45,292 INFO [StoreOpener-0bad15f8b77a93491f41e70639dc1fc8-1] regionserver.HStore(310): Store=0bad15f8b77a93491f41e70639dc1fc8/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:40:45,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:40:45,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/0000000000000000004 2023-07-12 13:40:45,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/0000000000000000004 2023-07-12 13:40:45,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 0bad15f8b77a93491f41e70639dc1fc8 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:45,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/.tmp/colfamily11/786a147b9ba8444d9079bfc90509a7e3 2023-07-12 13:40:45,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/.tmp/colfamily11/97dc5134c0a147d7affddb1d117227f5 2023-07-12 13:40:45,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/.tmp/colfamily11/786a147b9ba8444d9079bfc90509a7e3 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily11/786a147b9ba8444d9079bfc90509a7e3 2023-07-12 13:40:45,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/.tmp/colfamily11/97dc5134c0a147d7affddb1d117227f5 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily11/97dc5134c0a147d7affddb1d117227f5 2023-07-12 13:40:45,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/colfamily11/786a147b9ba8444d9079bfc90509a7e3, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 13:40:45,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 674f5b2fb0eacd68f031d75fb1103b80 in 53ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 13:40:45,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/0000000000000000004 2023-07-12 13:40:45,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:40:45,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:40:45,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/colfamily11/97dc5134c0a147d7affddb1d117227f5, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 13:40:45,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 0bad15f8b77a93491f41e70639dc1fc8 in 46ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 13:40:45,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/0000000000000000004 2023-07-12 13:40:45,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 13:40:45,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 674f5b2fb0eacd68f031d75fb1103b80; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68475828, jitterRate=0.020369350910186768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:40:45,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 674f5b2fb0eacd68f031d75fb1103b80: 2023-07-12 13:40:45,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80., pid=80, masterSystemTime=1689169245254 2023-07-12 13:40:45,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:40:45,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:40:45,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:40:45,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:40:45,352 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=674f5b2fb0eacd68f031d75fb1103b80, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:45,352 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245352"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169245352"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169245352"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169245352"}]},"ts":"1689169245352"} 2023-07-12 13:40:45,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4641e91601e8baa52f8f326a3d617a38, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2023-07-12 13:40:45,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:40:45,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:40:45,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:40:45,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:40:45,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:40:45,354 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:40:45,355 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily11 2023-07-12 13:40:45,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 13:40:45,356 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily11 2023-07-12 13:40:45,356 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4641e91601e8baa52f8f326a3d617a38 columnFamilyName colfamily11 2023-07-12 13:40:45,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=72 2023-07-12 13:40:45,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=72, state=SUCCESS; OpenRegionProcedure 674f5b2fb0eacd68f031d75fb1103b80, server=jenkins-hbase17.apache.org,35445,1689169089256 in 242 msec 2023-07-12 13:40:45,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0bad15f8b77a93491f41e70639dc1fc8; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71961635, jitterRate=0.07231192290782928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:40:45,357 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(310): Store=4641e91601e8baa52f8f326a3d617a38/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0bad15f8b77a93491f41e70639dc1fc8: 2023-07-12 13:40:45,357 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:40:45,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8., pid=85, masterSystemTime=1689169245274 2023-07-12 13:40:45,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=674f5b2fb0eacd68f031d75fb1103b80, ASSIGN in 423 msec 2023-07-12 13:40:45,359 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily21 2023-07-12 13:40:45,359 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily21 2023-07-12 13:40:45,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:40:45,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:40:45,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:40:45,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d1dc6d5e0bd7eff97daa4fe943dbce7, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2023-07-12 13:40:45,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:40:45,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:40:45,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:40:45,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:40:45,359 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4641e91601e8baa52f8f326a3d617a38 columnFamilyName colfamily21 2023-07-12 13:40:45,359 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0bad15f8b77a93491f41e70639dc1fc8, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:45,360 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245359"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169245359"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169245359"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169245359"}]},"ts":"1689169245359"} 2023-07-12 13:40:45,361 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(310): Store=4641e91601e8baa52f8f326a3d617a38/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,361 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:40:45,361 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:40:45,363 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily31 2023-07-12 13:40:45,363 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily11 2023-07-12 13:40:45,363 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily11 2023-07-12 13:40:45,363 DEBUG [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily31 2023-07-12 13:40:45,363 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4641e91601e8baa52f8f326a3d617a38 columnFamilyName colfamily31 2023-07-12 13:40:45,363 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d1dc6d5e0bd7eff97daa4fe943dbce7 columnFamilyName colfamily11 2023-07-12 13:40:45,364 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(310): Store=4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,364 INFO [StoreOpener-4641e91601e8baa52f8f326a3d617a38-1] regionserver.HStore(310): Store=4641e91601e8baa52f8f326a3d617a38/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,365 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:40:45,365 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=73 2023-07-12 13:40:45,365 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=73, state=SUCCESS; OpenRegionProcedure 0bad15f8b77a93491f41e70639dc1fc8, server=jenkins-hbase17.apache.org,34091,1689169089223 in 232 msec 2023-07-12 13:40:45,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:40:45,366 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily21 2023-07-12 13:40:45,366 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily21 2023-07-12 13:40:45,366 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d1dc6d5e0bd7eff97daa4fe943dbce7 columnFamilyName colfamily21 2023-07-12 13:40:45,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0bad15f8b77a93491f41e70639dc1fc8, ASSIGN in 431 msec 2023-07-12 13:40:45,367 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(310): Store=4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:40:45,367 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:40:45,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/0000000000000000004 2023-07-12 13:40:45,368 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily31 2023-07-12 13:40:45,368 DEBUG [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily31 2023-07-12 13:40:45,368 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d1dc6d5e0bd7eff97daa4fe943dbce7 columnFamilyName colfamily31 2023-07-12 13:40:45,369 INFO [StoreOpener-4d1dc6d5e0bd7eff97daa4fe943dbce7-1] regionserver.HStore(310): Store=4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:40:45,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:40:45,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/0000000000000000004 2023-07-12 13:40:45,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/0000000000000000004 2023-07-12 13:40:45,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 4641e91601e8baa52f8f326a3d617a38 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:45,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/0000000000000000004 2023-07-12 13:40:45,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 4d1dc6d5e0bd7eff97daa4fe943dbce7 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:45,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/.tmp/colfamily11/5eb808d06abc4df693654fee80787f99 2023-07-12 13:40:45,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/.tmp/colfamily11/b0cb9a4021be44f29d040aae11976153 2023-07-12 13:40:45,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/.tmp/colfamily11/5eb808d06abc4df693654fee80787f99 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily11/5eb808d06abc4df693654fee80787f99 2023-07-12 13:40:45,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/.tmp/colfamily11/b0cb9a4021be44f29d040aae11976153 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily11/b0cb9a4021be44f29d040aae11976153 2023-07-12 13:40:45,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/colfamily11/5eb808d06abc4df693654fee80787f99, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 13:40:45,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 4641e91601e8baa52f8f326a3d617a38 in 45ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 13:40:45,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/0000000000000000004 2023-07-12 13:40:45,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:40:45,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/colfamily11/b0cb9a4021be44f29d040aae11976153, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 13:40:45,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 4d1dc6d5e0bd7eff97daa4fe943dbce7 in 45ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 13:40:45,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/0000000000000000004 2023-07-12 13:40:45,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:40:45,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 13:40:45,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:40:45,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4641e91601e8baa52f8f326a3d617a38; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68601629, jitterRate=0.022243931889533997}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:40:45,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4641e91601e8baa52f8f326a3d617a38: 2023-07-12 13:40:45,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:40:45,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38., pid=79, masterSystemTime=1689169245254 2023-07-12 13:40:45,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:40:45,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:40:45,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:40:45,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 13:40:45,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92478ee2b34576368e173be7ee67f2a5, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5.', STARTKEY => 'ggg', ENDKEY => 'hhh'} 2023-07-12 13:40:45,429 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=4641e91601e8baa52f8f326a3d617a38, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:45,429 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245429"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169245429"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169245429"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169245429"}]},"ts":"1689169245429"} 2023-07-12 13:40:45,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:40:45,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:40:45,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:40:45,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:40:45,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4d1dc6d5e0bd7eff97daa4fe943dbce7; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75432300, jitterRate=0.12402886152267456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:40:45,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4d1dc6d5e0bd7eff97daa4fe943dbce7: 2023-07-12 13:40:45,431 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:40:45,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7., pid=84, masterSystemTime=1689169245274 2023-07-12 13:40:45,433 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily11 2023-07-12 13:40:45,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=79, resume processing ppid=69 2023-07-12 13:40:45,433 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily11 2023-07-12 13:40:45,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, ppid=69, state=SUCCESS; OpenRegionProcedure 4641e91601e8baa52f8f326a3d617a38, server=jenkins-hbase17.apache.org,35445,1689169089256 in 324 msec 2023-07-12 13:40:45,433 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92478ee2b34576368e173be7ee67f2a5 columnFamilyName colfamily11 2023-07-12 13:40:45,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:40:45,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:40:45,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:40:45,434 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(310): Store=92478ee2b34576368e173be7ee67f2a5/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 06b18c3992cc931e8054a4dcc480ece1, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2023-07-12 13:40:45,434 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:40:45,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4641e91601e8baa52f8f326a3d617a38, ASSIGN in 499 msec 2023-07-12 13:40:45,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:40:45,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:40:45,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:40:45,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:40:45,435 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=4d1dc6d5e0bd7eff97daa4fe943dbce7, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:45,435 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245435"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169245435"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169245435"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169245435"}]},"ts":"1689169245435"} 2023-07-12 13:40:45,435 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily21 2023-07-12 13:40:45,435 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily21 2023-07-12 13:40:45,435 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92478ee2b34576368e173be7ee67f2a5 columnFamilyName colfamily21 2023-07-12 13:40:45,436 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:40:45,436 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(310): Store=92478ee2b34576368e173be7ee67f2a5/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,436 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:40:45,437 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily11 2023-07-12 13:40:45,437 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily11 2023-07-12 13:40:45,438 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06b18c3992cc931e8054a4dcc480ece1 columnFamilyName colfamily11 2023-07-12 13:40:45,438 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily31 2023-07-12 13:40:45,438 DEBUG [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily31 2023-07-12 13:40:45,438 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92478ee2b34576368e173be7ee67f2a5 columnFamilyName colfamily31 2023-07-12 13:40:45,439 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(310): Store=06b18c3992cc931e8054a4dcc480ece1/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,439 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:40:45,439 INFO [StoreOpener-92478ee2b34576368e173be7ee67f2a5-1] regionserver.HStore(310): Store=92478ee2b34576368e173be7ee67f2a5/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=71 2023-07-12 13:40:45,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=71, state=SUCCESS; OpenRegionProcedure 4d1dc6d5e0bd7eff97daa4fe943dbce7, server=jenkins-hbase17.apache.org,34091,1689169089223 in 310 msec 2023-07-12 13:40:45,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:40:45,440 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily21 2023-07-12 13:40:45,440 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily21 2023-07-12 13:40:45,441 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06b18c3992cc931e8054a4dcc480ece1 columnFamilyName colfamily21 2023-07-12 13:40:45,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4d1dc6d5e0bd7eff97daa4fe943dbce7, ASSIGN in 505 msec 2023-07-12 13:40:45,441 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(310): Store=06b18c3992cc931e8054a4dcc480ece1/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,442 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:40:45,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:40:45,443 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily31 2023-07-12 13:40:45,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/0000000000000000004 2023-07-12 13:40:45,443 DEBUG [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily31 2023-07-12 13:40:45,443 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06b18c3992cc931e8054a4dcc480ece1 columnFamilyName colfamily31 2023-07-12 13:40:45,444 INFO [StoreOpener-06b18c3992cc931e8054a4dcc480ece1-1] regionserver.HStore(310): Store=06b18c3992cc931e8054a4dcc480ece1/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:40:45,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:40:45,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/0000000000000000004 2023-07-12 13:40:45,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/0000000000000000004 2023-07-12 13:40:45,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 92478ee2b34576368e173be7ee67f2a5 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:45,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/0000000000000000004 2023-07-12 13:40:45,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 06b18c3992cc931e8054a4dcc480ece1 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:45,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/.tmp/colfamily11/279c4331de8b462f92b84426ed0cebd6 2023-07-12 13:40:45,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/.tmp/colfamily11/f595e6f0a683420eb925262d6b2c3ad7 2023-07-12 13:40:45,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/.tmp/colfamily11/279c4331de8b462f92b84426ed0cebd6 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily11/279c4331de8b462f92b84426ed0cebd6 2023-07-12 13:40:45,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/.tmp/colfamily11/f595e6f0a683420eb925262d6b2c3ad7 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily11/f595e6f0a683420eb925262d6b2c3ad7 2023-07-12 13:40:45,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/colfamily11/279c4331de8b462f92b84426ed0cebd6, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 13:40:45,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/colfamily11/f595e6f0a683420eb925262d6b2c3ad7, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 13:40:45,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 06b18c3992cc931e8054a4dcc480ece1 in 36ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 13:40:45,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 92478ee2b34576368e173be7ee67f2a5 in 40ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 13:40:45,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/0000000000000000004 2023-07-12 13:40:45,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/0000000000000000004 2023-07-12 13:40:45,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:40:45,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:40:45,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:40:45,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:40:45,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 13:40:45,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 13:40:45,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 06b18c3992cc931e8054a4dcc480ece1; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75084395, jitterRate=0.11884467303752899}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:40:45,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 92478ee2b34576368e173be7ee67f2a5; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70471020, jitterRate=0.05010002851486206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:40:45,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 06b18c3992cc931e8054a4dcc480ece1: 2023-07-12 13:40:45,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 92478ee2b34576368e173be7ee67f2a5: 2023-07-12 13:40:45,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5., pid=81, masterSystemTime=1689169245254 2023-07-12 13:40:45,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1., pid=83, masterSystemTime=1689169245274 2023-07-12 13:40:45,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:40:45,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:40:45,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:40:45,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 221aa1ce383e614c344b914ded3151c4, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2023-07-12 13:40:45,499 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=77 updating hbase:meta row=06b18c3992cc931e8054a4dcc480ece1, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:45,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:40:45,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:40:45,499 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245499"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169245499"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169245499"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169245499"}]},"ts":"1689169245499"} 2023-07-12 13:40:45,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:40:45,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:40:45,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:40:45,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:40:45,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:40:45,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5140a4a30c94e149363cee692772d310, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2023-07-12 13:40:45,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 5140a4a30c94e149363cee692772d310 2023-07-12 13:40:45,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:40:45,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 5140a4a30c94e149363cee692772d310 2023-07-12 13:40:45,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 5140a4a30c94e149363cee692772d310 2023-07-12 13:40:45,501 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:40:45,502 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 5140a4a30c94e149363cee692772d310 2023-07-12 13:40:45,502 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily11 2023-07-12 13:40:45,502 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily11 2023-07-12 13:40:45,502 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 221aa1ce383e614c344b914ded3151c4 columnFamilyName colfamily11 2023-07-12 13:40:45,503 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily11 2023-07-12 13:40:45,503 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily11 2023-07-12 13:40:45,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=77 2023-07-12 13:40:45,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=77, state=SUCCESS; OpenRegionProcedure 06b18c3992cc931e8054a4dcc480ece1, server=jenkins-hbase17.apache.org,34091,1689169089223 in 378 msec 2023-07-12 13:40:45,503 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5140a4a30c94e149363cee692772d310 columnFamilyName colfamily11 2023-07-12 13:40:45,504 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(310): Store=221aa1ce383e614c344b914ded3151c4/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,504 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:40:45,504 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(310): Store=5140a4a30c94e149363cee692772d310/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,504 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 5140a4a30c94e149363cee692772d310 2023-07-12 13:40:45,505 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily21 2023-07-12 13:40:45,505 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily21 2023-07-12 13:40:45,505 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily21 2023-07-12 13:40:45,505 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily21 2023-07-12 13:40:45,505 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5140a4a30c94e149363cee692772d310 columnFamilyName colfamily21 2023-07-12 13:40:45,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=06b18c3992cc931e8054a4dcc480ece1, ASSIGN in 568 msec 2023-07-12 13:40:45,505 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 221aa1ce383e614c344b914ded3151c4 columnFamilyName colfamily21 2023-07-12 13:40:45,506 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(310): Store=5140a4a30c94e149363cee692772d310/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,506 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 5140a4a30c94e149363cee692772d310 2023-07-12 13:40:45,506 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(310): Store=221aa1ce383e614c344b914ded3151c4/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,506 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:40:45,506 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=92478ee2b34576368e173be7ee67f2a5, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:45,506 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245506"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169245506"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169245506"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169245506"}]},"ts":"1689169245506"} 2023-07-12 13:40:45,507 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily31 2023-07-12 13:40:45,507 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily31 2023-07-12 13:40:45,507 DEBUG [StoreOpener-5140a4a30c94e149363cee692772d310-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily31 2023-07-12 13:40:45,507 DEBUG [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily31 2023-07-12 13:40:45,508 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5140a4a30c94e149363cee692772d310 columnFamilyName colfamily31 2023-07-12 13:40:45,508 INFO [StoreOpener-5140a4a30c94e149363cee692772d310-1] regionserver.HStore(310): Store=5140a4a30c94e149363cee692772d310/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310 2023-07-12 13:40:45,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=75 2023-07-12 13:40:45,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=75, state=SUCCESS; OpenRegionProcedure 92478ee2b34576368e173be7ee67f2a5, server=jenkins-hbase17.apache.org,35445,1689169089256 in 391 msec 2023-07-12 13:40:45,508 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 221aa1ce383e614c344b914ded3151c4 columnFamilyName colfamily31 2023-07-12 13:40:45,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310 2023-07-12 13:40:45,512 INFO [StoreOpener-221aa1ce383e614c344b914ded3151c4-1] regionserver.HStore(310): Store=221aa1ce383e614c344b914ded3151c4/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/0000000000000000004 2023-07-12 13:40:45,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=92478ee2b34576368e173be7ee67f2a5, ASSIGN in 575 msec 2023-07-12 13:40:45,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4 2023-07-12 13:40:45,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4 2023-07-12 13:40:45,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/0000000000000000004 2023-07-12 13:40:45,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/0000000000000000004 2023-07-12 13:40:45,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 5140a4a30c94e149363cee692772d310 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:45,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/0000000000000000004 2023-07-12 13:40:45,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 221aa1ce383e614c344b914ded3151c4 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:45,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/.tmp/colfamily11/f52eedff42cf4e978e57076fa26b5850 2023-07-12 13:40:45,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/.tmp/colfamily11/f52eedff42cf4e978e57076fa26b5850 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily11/f52eedff42cf4e978e57076fa26b5850 2023-07-12 13:40:45,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/colfamily11/f52eedff42cf4e978e57076fa26b5850, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 13:40:45,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 221aa1ce383e614c344b914ded3151c4 in 39ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 13:40:45,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/0000000000000000004 2023-07-12 13:40:45,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:40:45,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:40:45,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 13:40:45,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 221aa1ce383e614c344b914ded3151c4; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64826425, jitterRate=-0.03401099145412445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:40:45,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 221aa1ce383e614c344b914ded3151c4: 2023-07-12 13:40:45,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4., pid=86, masterSystemTime=1689169245274 2023-07-12 13:40:45,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:40:45,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:40:45,570 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=221aa1ce383e614c344b914ded3151c4, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:45,570 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245570"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169245570"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169245570"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169245570"}]},"ts":"1689169245570"} 2023-07-12 13:40:45,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=76 2023-07-12 13:40:45,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=76, state=SUCCESS; OpenRegionProcedure 221aa1ce383e614c344b914ded3151c4, server=jenkins-hbase17.apache.org,34091,1689169089223 in 437 msec 2023-07-12 13:40:45,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=221aa1ce383e614c344b914ded3151c4, ASSIGN in 638 msec 2023-07-12 13:40:45,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/.tmp/colfamily11/4de8e6be4cae419ea597ac543d19cb7f 2023-07-12 13:40:45,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/.tmp/colfamily11/4de8e6be4cae419ea597ac543d19cb7f as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily11/4de8e6be4cae419ea597ac543d19cb7f 2023-07-12 13:40:45,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/colfamily11/4de8e6be4cae419ea597ac543d19cb7f, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 13:40:45,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 5140a4a30c94e149363cee692772d310 in 452ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 13:40:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/0000000000000000004 2023-07-12 13:40:45,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:40:45,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 5140a4a30c94e149363cee692772d310 2023-07-12 13:40:45,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 13:40:45,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 5140a4a30c94e149363cee692772d310; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68860119, jitterRate=0.026095733046531677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:40:45,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 5140a4a30c94e149363cee692772d310: 2023-07-12 13:40:45,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310., pid=82, masterSystemTime=1689169245254 2023-07-12 13:40:45,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:40:45,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:40:45,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:40:45,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 736207afd3173343fa3290362bfa994d, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2023-07-12 13:40:45,983 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=5140a4a30c94e149363cee692772d310, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:45,983 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169245983"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169245983"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169245983"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169245983"}]},"ts":"1689169245983"} 2023-07-12 13:40:45,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 736207afd3173343fa3290362bfa994d 2023-07-12 13:40:45,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 13:40:45,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 736207afd3173343fa3290362bfa994d 2023-07-12 13:40:45,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 736207afd3173343fa3290362bfa994d 2023-07-12 13:40:45,985 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 736207afd3173343fa3290362bfa994d 2023-07-12 13:40:45,986 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily11 2023-07-12 13:40:45,986 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily11 2023-07-12 13:40:45,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=74 2023-07-12 13:40:45,986 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 736207afd3173343fa3290362bfa994d columnFamilyName colfamily11 2023-07-12 13:40:45,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=74, state=SUCCESS; OpenRegionProcedure 5140a4a30c94e149363cee692772d310, server=jenkins-hbase17.apache.org,35445,1689169089256 in 864 msec 2023-07-12 13:40:45,987 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(310): Store=736207afd3173343fa3290362bfa994d/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,987 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 736207afd3173343fa3290362bfa994d 2023-07-12 13:40:45,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5140a4a30c94e149363cee692772d310, ASSIGN in 1.0520 sec 2023-07-12 13:40:45,988 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily21 2023-07-12 13:40:45,988 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily21 2023-07-12 13:40:45,989 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 736207afd3173343fa3290362bfa994d columnFamilyName colfamily21 2023-07-12 13:40:45,989 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(310): Store=736207afd3173343fa3290362bfa994d/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,989 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 736207afd3173343fa3290362bfa994d 2023-07-12 13:40:45,990 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily31 2023-07-12 13:40:45,990 DEBUG [StoreOpener-736207afd3173343fa3290362bfa994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily31 2023-07-12 13:40:45,991 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 736207afd3173343fa3290362bfa994d columnFamilyName colfamily31 2023-07-12 13:40:45,991 INFO [StoreOpener-736207afd3173343fa3290362bfa994d-1] regionserver.HStore(310): Store=736207afd3173343fa3290362bfa994d/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 13:40:45,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d 2023-07-12 13:40:45,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d 2023-07-12 13:40:45,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/0000000000000000004 2023-07-12 13:40:46,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/0000000000000000004 2023-07-12 13:40:46,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 736207afd3173343fa3290362bfa994d 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:46,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/.tmp/colfamily11/1354e52c151341499ca3b74a6676240c 2023-07-12 13:40:46,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/.tmp/colfamily11/1354e52c151341499ca3b74a6676240c as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily11/1354e52c151341499ca3b74a6676240c 2023-07-12 13:40:46,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/colfamily11/1354e52c151341499ca3b74a6676240c, entries=703, sequenceid=4, filesize=38.2 K 2023-07-12 13:40:46,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 736207afd3173343fa3290362bfa994d in 28ms, sequenceid=4, compaction requested=false; wal=null 2023-07-12 13:40:46,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/0000000000000000004 2023-07-12 13:40:46,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 13:40:46,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 736207afd3173343fa3290362bfa994d 2023-07-12 13:40:46,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-12 13:40:46,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 736207afd3173343fa3290362bfa994d; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69102086, jitterRate=0.029701322317123413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 13:40:46,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 736207afd3173343fa3290362bfa994d: 2023-07-12 13:40:46,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d., pid=78, masterSystemTime=1689169245254 2023-07-12 13:40:46,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:40:46,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:40:46,037 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=736207afd3173343fa3290362bfa994d, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:46,038 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689169246037"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689169246037"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689169246037"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689169246037"}]},"ts":"1689169246037"} 2023-07-12 13:40:46,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=78, resume processing ppid=70 2023-07-12 13:40:46,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, ppid=70, state=SUCCESS; OpenRegionProcedure 736207afd3173343fa3290362bfa994d, server=jenkins-hbase17.apache.org,35445,1689169089256 in 938 msec 2023-07-12 13:40:46,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=62 2023-07-12 13:40:46,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=736207afd3173343fa3290362bfa994d, ASSIGN in 1.1070 sec 2023-07-12 13:40:46,042 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase17.apache.org,39081,1689169089182 after splitting done 2023-07-12 13:40:46,042 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase17.apache.org,39081,1689169089182 from processing; numProcessing=0 2023-07-12 13:40:46,043 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-12 13:40:46,043 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:46,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 13:40:46,043 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-12 13:40:46,184 INFO [Listener at localhost.localdomain/40361] procedure.MasterProcedureTestingUtility(454): Restart 8 exec state=pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:46,185 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-12 13:40:46,185 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 13:40:46,185 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 13:40:46,186 ERROR [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 13:40:46,186 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-12 13:40:46,186 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-12 13:40:46,186 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-12 13:40:46,187 INFO [Listener at localhost.localdomain/40361] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 13:40:46,188 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 13:40:46,189 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25, 26, 27] 2023-07-12 13:40:46,189 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-12 13:40:46,190 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-12 13:40:46,190 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-12 13:40:46,190 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-12 13:40:46,190 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=69, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[36, 39, 60] 2023-07-12 13:40:46,190 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=79, ppid=69, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[40, 59] 2023-07-12 13:40:46,190 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=70, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[35, 37, 72] 2023-07-12 13:40:46,190 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=78, ppid=70, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[38, 71] 2023-07-12 13:40:46,190 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=71, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[34, 49, 62] 2023-07-12 13:40:46,191 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=84, ppid=71, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[50, 61] 2023-07-12 13:40:46,191 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=72, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[33, 41, 56] 2023-07-12 13:40:46,191 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=80, ppid=72, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[42, 55] 2023-07-12 13:40:46,191 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=73, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[32, 51, 58] 2023-07-12 13:40:46,191 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=85, ppid=73, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[52, 57] 2023-07-12 13:40:46,191 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=74, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[31, 45, 70] 2023-07-12 13:40:46,191 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=82, ppid=74, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[46, 69] 2023-07-12 13:40:46,191 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=75, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[30, 43, 66] 2023-07-12 13:40:46,191 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=81, ppid=75, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[44, 65] 2023-07-12 13:40:46,192 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=76, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[29, 53, 68] 2023-07-12 13:40:46,192 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=86, ppid=76, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[54, 67] 2023-07-12 13:40:46,192 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=77, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[28, 47, 64] 2023-07-12 13:40:46,192 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=83, ppid=77, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[48, 63] 2023-07-12 13:40:46,192 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-12 13:40:46,192 DEBUG [Listener at localhost.localdomain/40361] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-12 13:40:46,192 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 13:40:46,193 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 13:40:46,193 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 13:40:46,193 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 13:40:46,194 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-12 13:40:46,197 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true 2023-07-12 13:40:46,197 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:46,197 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:46,197 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 13:40:46,197 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:46,197 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:46,197 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:46,197 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4641e91601e8baa52f8f326a3d617a38, ASSIGN 2023-07-12 13:40:46,197 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=736207afd3173343fa3290362bfa994d, ASSIGN 2023-07-12 13:40:46,197 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4d1dc6d5e0bd7eff97daa4fe943dbce7, ASSIGN 2023-07-12 13:40:46,197 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=674f5b2fb0eacd68f031d75fb1103b80, ASSIGN 2023-07-12 13:40:46,198 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0bad15f8b77a93491f41e70639dc1fc8, ASSIGN 2023-07-12 13:40:46,198 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5140a4a30c94e149363cee692772d310, ASSIGN 2023-07-12 13:40:46,198 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=92478ee2b34576368e173be7ee67f2a5, ASSIGN 2023-07-12 13:40:46,198 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=221aa1ce383e614c344b914ded3151c4, ASSIGN 2023-07-12 13:40:46,198 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=06b18c3992cc931e8054a4dcc480ece1, ASSIGN 2023-07-12 13:40:46,198 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=78, ppid=70, state=SUCCESS; OpenRegionProcedure 736207afd3173343fa3290362bfa994d, server=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:46,198 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=79, ppid=69, state=SUCCESS; OpenRegionProcedure 4641e91601e8baa52f8f326a3d617a38, server=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:46,198 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=80, ppid=72, state=SUCCESS; OpenRegionProcedure 674f5b2fb0eacd68f031d75fb1103b80, server=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:46,198 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=81, ppid=75, state=SUCCESS; OpenRegionProcedure 92478ee2b34576368e173be7ee67f2a5, server=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:46,198 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=82, ppid=74, state=SUCCESS; OpenRegionProcedure 5140a4a30c94e149363cee692772d310, server=jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:46,200 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=83, ppid=77, state=SUCCESS; OpenRegionProcedure 06b18c3992cc931e8054a4dcc480ece1, server=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:46,200 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=84, ppid=71, state=SUCCESS; OpenRegionProcedure 4d1dc6d5e0bd7eff97daa4fe943dbce7, server=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:46,200 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=85, ppid=73, state=SUCCESS; OpenRegionProcedure 0bad15f8b77a93491f41e70639dc1fc8, server=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:46,200 DEBUG [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(468): Loading pid=86, ppid=76, state=SUCCESS; OpenRegionProcedure 221aa1ce383e614c344b914ded3151c4, server=jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.meta.1689169091118.meta, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase17.apache.org%2C39081%2C1689169089182.1689169090851, worker=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4641e91601e8baa52f8f326a3d617a38, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=736207afd3173343fa3290362bfa994d, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=4d1dc6d5e0bd7eff97daa4fe943dbce7, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=674f5b2fb0eacd68f031d75fb1103b80, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=0bad15f8b77a93491f41e70639dc1fc8, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,201 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5140a4a30c94e149363cee692772d310, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=92478ee2b34576368e173be7ee67f2a5, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=221aa1ce383e614c344b914ded3151c4, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=06b18c3992cc931e8054a4dcc480ece1, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=78, ppid=70, state=SUCCESS; OpenRegionProcedure 736207afd3173343fa3290362bfa994d, server=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=79, ppid=69, state=SUCCESS; OpenRegionProcedure 4641e91601e8baa52f8f326a3d617a38, server=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=80, ppid=72, state=SUCCESS; OpenRegionProcedure 674f5b2fb0eacd68f031d75fb1103b80, server=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=81, ppid=75, state=SUCCESS; OpenRegionProcedure 92478ee2b34576368e173be7ee67f2a5, server=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=82, ppid=74, state=SUCCESS; OpenRegionProcedure 5140a4a30c94e149363cee692772d310, server=jenkins-hbase17.apache.org,35445,1689169089256 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=83, ppid=77, state=SUCCESS; OpenRegionProcedure 06b18c3992cc931e8054a4dcc480ece1, server=jenkins-hbase17.apache.org,34091,1689169089223 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=84, ppid=71, state=SUCCESS; OpenRegionProcedure 4d1dc6d5e0bd7eff97daa4fe943dbce7, server=jenkins-hbase17.apache.org,34091,1689169089223 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=85, ppid=73, state=SUCCESS; OpenRegionProcedure 0bad15f8b77a93491f41e70639dc1fc8, server=jenkins-hbase17.apache.org,34091,1689169089223 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 DEBUG [Listener at localhost.localdomain/40361] procedure2.Procedure(946): pid=86, ppid=76, state=SUCCESS; OpenRegionProcedure 221aa1ce383e614c344b914ded3151c4, server=jenkins-hbase17.apache.org,34091,1689169089223 didn't hold the lock before restarting, skip acquiring lock. 2023-07-12 13:40:46,202 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 14 msec 2023-07-12 13:40:46,203 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 13:40:46,204 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase17.apache.org,35445,1689169089256, table=hbase:meta, region=1588230740 2023-07-12 13:40:46,204 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689169276204 2023-07-12 13:40:46,204 DEBUG [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 13:40:46,205 DEBUG [PEWorker-1] master.DeadServer(103): Processing jenkins-hbase17.apache.org,39081,1689169089182; numProcessing=1 2023-07-12 13:40:46,213 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e303901740e4d02964c49fa9d2b7f856, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:46,214 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=ec05a52723edbecd7be77f36806caa8a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:46,214 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=216faae9d032640dca24ddf65ab9f909, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:46,214 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5140a4a30c94e149363cee692772d310, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=5 2023-07-12 13:40:46,214 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=221aa1ce383e614c344b914ded3151c4, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=5 2023-07-12 13:40:46,214 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=e3b643504d1d8a33902c66ba6c8a69fd, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:46,214 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=555ad7ad110af9ec101b9dfc5a07fa5c, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:46,215 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=92478ee2b34576368e173be7ee67f2a5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=5 2023-07-12 13:40:46,215 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=260e260b05fbc83a4eb4ced4fbf3a9d8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:46,215 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=912c554550dbcecd943b5e17bf1b23fc, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:46,215 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=0bad15f8b77a93491f41e70639dc1fc8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=5 2023-07-12 13:40:46,215 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fd43ad19523fd1e39bad44724f1ef3da, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:46,215 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=f9e1981fea95432fc8fb92eb7cc4524d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:46,215 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=674f5b2fb0eacd68f031d75fb1103b80, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=5 2023-07-12 13:40:46,215 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4d1dc6d5e0bd7eff97daa4fe943dbce7, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=5 2023-07-12 13:40:46,216 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=fa76a2771db04ba3b6a7d1be4a08daf8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:46,216 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=b38842d7461fd90c4f30b3afd99f11b8, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:46,216 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=4641e91601e8baa52f8f326a3d617a38, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=5 2023-07-12 13:40:46,216 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=a623158b89e27dff4b3c43e771d2b672, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:46,216 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=5c50497f7f74f39b808201e941fd8963, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:46,216 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=20ad56ffb65cb5bab6d1f89dc701d381, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:46,216 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=06b18c3992cc931e8054a4dcc480ece1, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=5 2023-07-12 13:40:46,216 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=6deb0a5007b6ff006e3a4a9f7e3b5f3d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:46,217 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=c4e74d3136130f438093e2507612b0b5, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:46,217 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=736207afd3173343fa3290362bfa994d, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=5 2023-07-12 13:40:46,217 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=98e8c1a65ac96e53d5bdaf4943cf497a, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,34091,1689169089223, regionLocation=jenkins-hbase17.apache.org,34091,1689169089223, openSeqNum=2 2023-07-12 13:40:46,217 DEBUG [Listener at localhost.localdomain/40361] assignment.RegionStateStore(147): Load hbase:meta entry region=19ef6586ee290d893dc86ad8b10dd468, regionState=OPEN, lastHost=jenkins-hbase17.apache.org,35445,1689169089256, regionLocation=jenkins-hbase17.apache.org,35445,1689169089256, openSeqNum=2 2023-07-12 13:40:46,217 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 13:40:46,217 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689169306217 2023-07-12 13:40:46,217 INFO [Listener at localhost.localdomain/40361] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689169366217 2023-07-12 13:40:46,217 INFO [Listener at localhost.localdomain/40361] assignment.AssignmentManager(1536): Joined the cluster in 13 msec 2023-07-12 13:40:46,217 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase17.apache.org,39081,1689169089182 after splitting done 2023-07-12 13:40:46,218 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase17.apache.org,39081,1689169089182 from processing; numProcessing=0 2023-07-12 13:40:46,218 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-12 13:40:46,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; ServerCrashProcedure jenkins-hbase17.apache.org,39081,1689169089182, splitWal=true, meta=true in 2 mins, 28.545 sec 2023-07-12 13:40:46,472 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 13:40:46,483 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:40:46,490 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 13:40:46,493 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 13:40:46,496 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 13:40:46,498 WARN [RPCClient-NioEventLoopGroup-6-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase17.apache.org/136.243.18.41:39081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:716) at org.apache.hbase.thirdparty.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 13:40:46,499 DEBUG [RPCClient-NioEventLoopGroup-6-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase17.apache.org/136.243.18.41:39081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase17.apache.org/136.243.18.41:39081 2023-07-12 13:40:46,601 DEBUG [hconnection-0x5b9b07b5-shared-pool-9] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:40:46,739 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 13:40:46,739 DEBUG [hconnection-0x5b9b07b5-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:40:46,858 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 13:40:46,861 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 13:40:46,864 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 13:40:46,864 DEBUG [hconnection-0x5b9b07b5-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:40:46,984 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 13:40:46,987 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 13:40:46,990 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 13:40:46,990 DEBUG [hconnection-0x5b9b07b5-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:40:47,101 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 13:40:47,104 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 13:40:47,106 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 13:40:47,106 DEBUG [hconnection-0x5b9b07b5-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:40:47,218 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 13:40:47,218 DEBUG [hconnection-0x5b9b07b5-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:40:47,328 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 13:40:47,330 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 13:40:47,333 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 13:40:47,333 DEBUG [hconnection-0x5b9b07b5-shared-pool-11] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:40:47,447 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 13:40:47,449 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 13:40:47,451 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 13:40:47,453 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 13:40:47,454 DEBUG [hconnection-0x5b9b07b5-shared-pool-9] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:40:47,567 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 13:40:47,570 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 13:40:47,573 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 13:40:47,573 DEBUG [hconnection-0x5b9b07b5-shared-pool-12] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase17.apache.org/136.243.18.41:39081 this server is in the failed servers list 2023-07-12 13:40:47,682 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 13:40:47,685 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 13:40:47,689 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-12 13:40:47,692 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-12 13:40:47,694 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-12 13:40:47,697 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-12 13:40:47,700 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-12 13:40:47,703 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-12 13:40:47,706 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-12 13:40:47,709 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-12 13:40:47,711 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-12 13:40:47,714 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-12 13:40:47,717 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-12 13:40:47,720 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-12 13:40:47,723 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-12 13:40:47,726 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-12 13:40:47,728 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-12 13:40:47,730 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-12 13:40:47,733 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-12 13:40:47,735 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-12 13:40:47,738 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-12 13:40:47,740 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-12 13:40:47,742 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-12 13:40:47,745 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-12 13:40:47,747 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-12 13:40:47,749 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-12 13:40:47,751 DEBUG [Listener at localhost.localdomain/40361] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-12 13:40:47,754 WARN [Listener at localhost.localdomain/40361] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-12 13:40:47,754 INFO [Listener at localhost.localdomain/40361] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 13:40:47,754 INFO [Listener at localhost.localdomain/40361] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 13:40:47,755 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01ae8a1e to 127.0.0.1:56143 2023-07-12 13:40:47,755 DEBUG [Listener at localhost.localdomain/40361] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:40:47,756 DEBUG [Listener at localhost.localdomain/40361] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 13:40:47,756 DEBUG [Listener at localhost.localdomain/40361] util.JVMClusterUtil(257): Found active master hash=449485541, stopped=false 2023-07-12 13:40:47,756 INFO [Listener at localhost.localdomain/40361] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,42137,1689169087924 2023-07-12 13:40:47,760 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 13:40:47,760 INFO [Listener at localhost.localdomain/40361] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 13:40:47,760 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 13:40:47,761 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:40:47,760 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 13:40:47,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 13:40:47,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 13:40:47,763 DEBUG [Listener at localhost.localdomain/40361] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53bcf140 to 127.0.0.1:56143 2023-07-12 13:40:47,764 DEBUG [Listener at localhost.localdomain/40361] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:40:47,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 13:40:47,764 INFO [Listener at localhost.localdomain/40361] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,34091,1689169089223' ***** 2023-07-12 13:40:47,764 INFO [Listener at localhost.localdomain/40361] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 13:40:47,764 INFO [Listener at localhost.localdomain/40361] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,35445,1689169089256' ***** 2023-07-12 13:40:47,764 INFO [Listener at localhost.localdomain/40361] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 13:40:47,764 INFO [RS:1;jenkins-hbase17:34091] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 13:40:47,765 INFO [RS:2;jenkins-hbase17:35445] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 13:40:47,765 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 13:40:47,765 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 13:40:47,765 INFO [RS:2;jenkins-hbase17:35445] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 13:40:47,765 INFO [RS:1;jenkins-hbase17:34091] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 13:40:47,766 INFO [RS:2;jenkins-hbase17:35445] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 13:40:47,766 INFO [RS:1;jenkins-hbase17:34091] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 13:40:47,766 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for 555ad7ad110af9ec101b9dfc5a07fa5c 2023-07-12 13:40:47,766 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for 4641e91601e8baa52f8f326a3d617a38 2023-07-12 13:40:47,767 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for 6deb0a5007b6ff006e3a4a9f7e3b5f3d 2023-07-12 13:40:47,767 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for c4e74d3136130f438093e2507612b0b5 2023-07-12 13:40:47,767 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for 4d1dc6d5e0bd7eff97daa4fe943dbce7 2023-07-12 13:40:47,767 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for 92478ee2b34576368e173be7ee67f2a5 2023-07-12 13:40:47,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 555ad7ad110af9ec101b9dfc5a07fa5c, disabling compactions & flushes 2023-07-12 13:40:47,768 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for b38842d7461fd90c4f30b3afd99f11b8 2023-07-12 13:40:47,768 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for 221aa1ce383e614c344b914ded3151c4 2023-07-12 13:40:47,768 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for 19ef6586ee290d893dc86ad8b10dd468 2023-07-12 13:40:47,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 4641e91601e8baa52f8f326a3d617a38, disabling compactions & flushes 2023-07-12 13:40:47,768 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for ec05a52723edbecd7be77f36806caa8a 2023-07-12 13:40:47,768 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:40:47,768 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:40:47,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:40:47,768 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 13:40:47,768 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for 674f5b2fb0eacd68f031d75fb1103b80 2023-07-12 13:40:47,768 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for 0bad15f8b77a93491f41e70639dc1fc8 2023-07-12 13:40:47,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:40:47,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:40:47,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. after waiting 0 ms 2023-07-12 13:40:47,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:40:47,769 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for a623158b89e27dff4b3c43e771d2b672 2023-07-12 13:40:47,769 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for 5c50497f7f74f39b808201e941fd8963 2023-07-12 13:40:47,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:40:47,769 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for 5140a4a30c94e149363cee692772d310 2023-07-12 13:40:47,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. after waiting 0 ms 2023-07-12 13:40:47,769 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for e3b643504d1d8a33902c66ba6c8a69fd 2023-07-12 13:40:47,769 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 13:40:47,769 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for e303901740e4d02964c49fa9d2b7f856 2023-07-12 13:40:47,769 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for 912c554550dbcecd943b5e17bf1b23fc 2023-07-12 13:40:47,769 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for 260e260b05fbc83a4eb4ced4fbf3a9d8 2023-07-12 13:40:47,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:40:47,769 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for 98e8c1a65ac96e53d5bdaf4943cf497a 2023-07-12 13:40:47,769 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for 736207afd3173343fa3290362bfa994d 2023-07-12 13:40:47,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 555ad7ad110af9ec101b9dfc5a07fa5c 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:47,769 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:47,769 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for 216faae9d032640dca24ddf65ab9f909 2023-07-12 13:40:47,769 DEBUG [RS:2;jenkins-hbase17:35445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30d81752 to 127.0.0.1:56143 2023-07-12 13:40:47,769 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for 20ad56ffb65cb5bab6d1f89dc701d381 2023-07-12 13:40:47,770 DEBUG [RS:2;jenkins-hbase17:35445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:40:47,770 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for 06b18c3992cc931e8054a4dcc480ece1 2023-07-12 13:40:47,770 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(3305): Received CLOSE for f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:40:47,771 INFO [RS:2;jenkins-hbase17:35445] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 13:40:47,771 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:47,771 INFO [RS:2;jenkins-hbase17:35445] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 13:40:47,771 INFO [RS:2;jenkins-hbase17:35445] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 13:40:47,771 DEBUG [RS:1;jenkins-hbase17:34091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x560f95b6 to 127.0.0.1:56143 2023-07-12 13:40:47,771 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 13:40:47,771 DEBUG [RS:1;jenkins-hbase17:34091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:40:47,773 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1474): Waiting on 13 regions to close 2023-07-12 13:40:47,773 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1474): Waiting on 15 regions to close 2023-07-12 13:40:47,774 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 13:40:47,775 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 13:40:47,775 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 13:40:47,775 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 13:40:47,775 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 13:40:47,775 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=13.64 KB heapSize=19.66 KB 2023-07-12 13:40:47,776 DEBUG [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1504): Waiting on 1588230740, 19ef6586ee290d893dc86ad8b10dd468, 260e260b05fbc83a4eb4ced4fbf3a9d8, 4641e91601e8baa52f8f326a3d617a38, 5140a4a30c94e149363cee692772d310, 5c50497f7f74f39b808201e941fd8963, 674f5b2fb0eacd68f031d75fb1103b80, 736207afd3173343fa3290362bfa994d, 92478ee2b34576368e173be7ee67f2a5, b38842d7461fd90c4f30b3afd99f11b8, c4e74d3136130f438093e2507612b0b5, e303901740e4d02964c49fa9d2b7f856, e3b643504d1d8a33902c66ba6c8a69fd, ec05a52723edbecd7be77f36806caa8a, fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:40:47,776 DEBUG [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1504): Waiting on 06b18c3992cc931e8054a4dcc480ece1, 0bad15f8b77a93491f41e70639dc1fc8, 20ad56ffb65cb5bab6d1f89dc701d381, 216faae9d032640dca24ddf65ab9f909, 221aa1ce383e614c344b914ded3151c4, 4d1dc6d5e0bd7eff97daa4fe943dbce7, 555ad7ad110af9ec101b9dfc5a07fa5c, 6deb0a5007b6ff006e3a4a9f7e3b5f3d, 912c554550dbcecd943b5e17bf1b23fc, 98e8c1a65ac96e53d5bdaf4943cf497a, a623158b89e27dff4b3c43e771d2b672, f9e1981fea95432fc8fb92eb7cc4524d, fa76a2771db04ba3b6a7d1be4a08daf8 2023-07-12 13:40:47,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4641e91601e8baa52f8f326a3d617a38/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 13:40:47,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:40:47,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 4641e91601e8baa52f8f326a3d617a38: 2023-07-12 13:40:47,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689169092267.4641e91601e8baa52f8f326a3d617a38. 2023-07-12 13:40:47,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing c4e74d3136130f438093e2507612b0b5, disabling compactions & flushes 2023-07-12 13:40:47,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:40:47,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:40:47,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. after waiting 0 ms 2023-07-12 13:40:47,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:40:47,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing c4e74d3136130f438093e2507612b0b5 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:47,816 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.64 KB at sequenceid=84 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/.tmp/info/58641a78204d492ebaeeee9df963afdc 2023-07-12 13:40:47,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/.tmp/colfamily11/c941ae069d9f4897837dd85a82f8355b 2023-07-12 13:40:47,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/.tmp/colfamily11/dc7173f96a044a3f9d50937085acccdf 2023-07-12 13:40:47,825 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/.tmp/info/58641a78204d492ebaeeee9df963afdc as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/info/58641a78204d492ebaeeee9df963afdc 2023-07-12 13:40:47,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/.tmp/colfamily11/dc7173f96a044a3f9d50937085acccdf as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/colfamily11/dc7173f96a044a3f9d50937085acccdf 2023-07-12 13:40:47,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/.tmp/colfamily11/c941ae069d9f4897837dd85a82f8355b as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/colfamily11/c941ae069d9f4897837dd85a82f8355b 2023-07-12 13:40:47,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/info/58641a78204d492ebaeeee9df963afdc, entries=72, sequenceid=84, filesize=18.7 K 2023-07-12 13:40:47,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/colfamily11/c941ae069d9f4897837dd85a82f8355b, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:47,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/colfamily11/dc7173f96a044a3f9d50937085acccdf, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:47,835 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~13.64 KB/13968, heapSize ~19.15 KB/19608, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=84, compaction requested=false 2023-07-12 13:40:47,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for c4e74d3136130f438093e2507612b0b5 in 55ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:47,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 555ad7ad110af9ec101b9dfc5a07fa5c in 67ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:47,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c4e74d3136130f438093e2507612b0b5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:47,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/555ad7ad110af9ec101b9dfc5a07fa5c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:47,845 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/meta/1588230740/recovered.edits/87.seqid, newMaxSeqId=87, maxSeqId=63 2023-07-12 13:40:47,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:40:47,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for c4e74d3136130f438093e2507612b0b5: 2023-07-12 13:40:47,847 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 13:40:47,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689169092267.c4e74d3136130f438093e2507612b0b5. 2023-07-12 13:40:47,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 92478ee2b34576368e173be7ee67f2a5, disabling compactions & flushes 2023-07-12 13:40:47,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:40:47,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:40:47,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:40:47,847 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 13:40:47,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 555ad7ad110af9ec101b9dfc5a07fa5c: 2023-07-12 13:40:47,848 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 13:40:47,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. after waiting 0 ms 2023-07-12 13:40:47,848 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 13:40:47,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689169092267.555ad7ad110af9ec101b9dfc5a07fa5c. 2023-07-12 13:40:47,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:40:47,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 6deb0a5007b6ff006e3a4a9f7e3b5f3d, disabling compactions & flushes 2023-07-12 13:40:47,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:40:47,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:40:47,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. after waiting 0 ms 2023-07-12 13:40:47,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:40:47,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 6deb0a5007b6ff006e3a4a9f7e3b5f3d 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:47,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/92478ee2b34576368e173be7ee67f2a5/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 13:40:47,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:40:47,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 92478ee2b34576368e173be7ee67f2a5: 2023-07-12 13:40:47,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689169092267.92478ee2b34576368e173be7ee67f2a5. 2023-07-12 13:40:47,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b38842d7461fd90c4f30b3afd99f11b8, disabling compactions & flushes 2023-07-12 13:40:47,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:40:47,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:40:47,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. after waiting 0 ms 2023-07-12 13:40:47,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:40:47,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing b38842d7461fd90c4f30b3afd99f11b8 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:47,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/.tmp/colfamily11/47370899826d430dacc15353849ee7bc 2023-07-12 13:40:47,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/.tmp/colfamily11/195164a4a5e6464c9a5ea26bc8b522e0 2023-07-12 13:40:47,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/.tmp/colfamily11/47370899826d430dacc15353849ee7bc as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/colfamily11/47370899826d430dacc15353849ee7bc 2023-07-12 13:40:47,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/.tmp/colfamily11/195164a4a5e6464c9a5ea26bc8b522e0 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/colfamily11/195164a4a5e6464c9a5ea26bc8b522e0 2023-07-12 13:40:47,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/colfamily11/47370899826d430dacc15353849ee7bc, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:47,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 6deb0a5007b6ff006e3a4a9f7e3b5f3d in 36ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:47,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/colfamily11/195164a4a5e6464c9a5ea26bc8b522e0, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:47,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6deb0a5007b6ff006e3a4a9f7e3b5f3d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:47,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for b38842d7461fd90c4f30b3afd99f11b8 in 30ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:47,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:40:47,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 6deb0a5007b6ff006e3a4a9f7e3b5f3d: 2023-07-12 13:40:47,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689169092267.6deb0a5007b6ff006e3a4a9f7e3b5f3d. 2023-07-12 13:40:47,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 4d1dc6d5e0bd7eff97daa4fe943dbce7, disabling compactions & flushes 2023-07-12 13:40:47,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:40:47,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:40:47,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. after waiting 0 ms 2023-07-12 13:40:47,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:40:47,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/b38842d7461fd90c4f30b3afd99f11b8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:47,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/4d1dc6d5e0bd7eff97daa4fe943dbce7/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 13:40:47,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:40:47,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b38842d7461fd90c4f30b3afd99f11b8: 2023-07-12 13:40:47,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689169092267.b38842d7461fd90c4f30b3afd99f11b8. 2023-07-12 13:40:47,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 19ef6586ee290d893dc86ad8b10dd468, disabling compactions & flushes 2023-07-12 13:40:47,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:40:47,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:40:47,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 4d1dc6d5e0bd7eff97daa4fe943dbce7: 2023-07-12 13:40:47,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:40:47,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. after waiting 0 ms 2023-07-12 13:40:47,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689169092267.4d1dc6d5e0bd7eff97daa4fe943dbce7. 2023-07-12 13:40:47,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:40:47,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 19ef6586ee290d893dc86ad8b10dd468 3/3 column families, dataSize=48 B heapSize=888 B 2023-07-12 13:40:47,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 221aa1ce383e614c344b914ded3151c4, disabling compactions & flushes 2023-07-12 13:40:47,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:40:47,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:40:47,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. after waiting 0 ms 2023-07-12 13:40:47,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:40:47,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/221aa1ce383e614c344b914ded3151c4/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 13:40:47,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:40:47,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 221aa1ce383e614c344b914ded3151c4: 2023-07-12 13:40:47,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689169092267.221aa1ce383e614c344b914ded3151c4. 2023-07-12 13:40:47,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing fa76a2771db04ba3b6a7d1be4a08daf8, disabling compactions & flushes 2023-07-12 13:40:47,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:40:47,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:40:47,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. after waiting 0 ms 2023-07-12 13:40:47,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:40:47,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing fa76a2771db04ba3b6a7d1be4a08daf8 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:47,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48 B at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/.tmp/colfamily11/8d5fb3ce8b7a440fb5f55eb35d0bb5ab 2023-07-12 13:40:47,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/.tmp/colfamily11/8d5fb3ce8b7a440fb5f55eb35d0bb5ab as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/colfamily11/8d5fb3ce8b7a440fb5f55eb35d0bb5ab 2023-07-12 13:40:47,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/.tmp/colfamily11/8ceeaf4b542044f791a11cd51f9b65cd 2023-07-12 13:40:47,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/colfamily11/8d5fb3ce8b7a440fb5f55eb35d0bb5ab, entries=1, sequenceid=5, filesize=4.6 K 2023-07-12 13:40:47,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 19ef6586ee290d893dc86ad8b10dd468 in 37ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:47,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/.tmp/colfamily11/8ceeaf4b542044f791a11cd51f9b65cd as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/colfamily11/8ceeaf4b542044f791a11cd51f9b65cd 2023-07-12 13:40:47,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/19ef6586ee290d893dc86ad8b10dd468/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:47,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:40:47,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 19ef6586ee290d893dc86ad8b10dd468: 2023-07-12 13:40:47,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689169092267.19ef6586ee290d893dc86ad8b10dd468. 2023-07-12 13:40:47,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing ec05a52723edbecd7be77f36806caa8a, disabling compactions & flushes 2023-07-12 13:40:47,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:40:47,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:40:47,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. after waiting 0 ms 2023-07-12 13:40:47,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:40:47,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing ec05a52723edbecd7be77f36806caa8a 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:47,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/colfamily11/8ceeaf4b542044f791a11cd51f9b65cd, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:47,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for fa76a2771db04ba3b6a7d1be4a08daf8 in 40ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:47,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fa76a2771db04ba3b6a7d1be4a08daf8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:47,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:40:47,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for fa76a2771db04ba3b6a7d1be4a08daf8: 2023-07-12 13:40:47,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689169092267.fa76a2771db04ba3b6a7d1be4a08daf8. 2023-07-12 13:40:47,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0bad15f8b77a93491f41e70639dc1fc8, disabling compactions & flushes 2023-07-12 13:40:47,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:40:47,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:40:47,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. after waiting 0 ms 2023-07-12 13:40:47,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:40:47,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/.tmp/colfamily11/8740c0d0e0c1439791005b570cb2164f 2023-07-12 13:40:47,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/0bad15f8b77a93491f41e70639dc1fc8/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 13:40:47,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:40:47,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0bad15f8b77a93491f41e70639dc1fc8: 2023-07-12 13:40:47,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689169092267.0bad15f8b77a93491f41e70639dc1fc8. 2023-07-12 13:40:47,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a623158b89e27dff4b3c43e771d2b672, disabling compactions & flushes 2023-07-12 13:40:47,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:40:47,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:40:47,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. after waiting 0 ms 2023-07-12 13:40:47,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:40:47,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing a623158b89e27dff4b3c43e771d2b672 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:47,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/.tmp/colfamily11/8740c0d0e0c1439791005b570cb2164f as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/colfamily11/8740c0d0e0c1439791005b570cb2164f 2023-07-12 13:40:47,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/colfamily11/8740c0d0e0c1439791005b570cb2164f, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:47,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ec05a52723edbecd7be77f36806caa8a in 35ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:47,977 DEBUG [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1504): Waiting on 260e260b05fbc83a4eb4ced4fbf3a9d8, 5140a4a30c94e149363cee692772d310, 5c50497f7f74f39b808201e941fd8963, 674f5b2fb0eacd68f031d75fb1103b80, 736207afd3173343fa3290362bfa994d, e303901740e4d02964c49fa9d2b7f856, e3b643504d1d8a33902c66ba6c8a69fd, ec05a52723edbecd7be77f36806caa8a, fd43ad19523fd1e39bad44724f1ef3da 2023-07-12 13:40:47,977 DEBUG [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1504): Waiting on 06b18c3992cc931e8054a4dcc480ece1, 20ad56ffb65cb5bab6d1f89dc701d381, 216faae9d032640dca24ddf65ab9f909, 912c554550dbcecd943b5e17bf1b23fc, 98e8c1a65ac96e53d5bdaf4943cf497a, a623158b89e27dff4b3c43e771d2b672, f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:40:47,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/.tmp/colfamily11/7c840760749f490586c8369594fe9404 2023-07-12 13:40:47,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec05a52723edbecd7be77f36806caa8a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:47,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:40:47,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for ec05a52723edbecd7be77f36806caa8a: 2023-07-12 13:40:47,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689169092267.ec05a52723edbecd7be77f36806caa8a. 2023-07-12 13:40:47,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing fd43ad19523fd1e39bad44724f1ef3da, disabling compactions & flushes 2023-07-12 13:40:47,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:40:47,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:40:47,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. after waiting 0 ms 2023-07-12 13:40:47,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:40:47,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing fd43ad19523fd1e39bad44724f1ef3da 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:47,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/.tmp/colfamily11/7c840760749f490586c8369594fe9404 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/colfamily11/7c840760749f490586c8369594fe9404 2023-07-12 13:40:48,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/colfamily11/7c840760749f490586c8369594fe9404, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:48,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for a623158b89e27dff4b3c43e771d2b672 in 35ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:48,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/.tmp/colfamily11/25550461cb8d42d5a72f46402a30a652 2023-07-12 13:40:48,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a623158b89e27dff4b3c43e771d2b672/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:48,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:40:48,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a623158b89e27dff4b3c43e771d2b672: 2023-07-12 13:40:48,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689169092267.a623158b89e27dff4b3c43e771d2b672. 2023-07-12 13:40:48,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 912c554550dbcecd943b5e17bf1b23fc, disabling compactions & flushes 2023-07-12 13:40:48,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:40:48,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:40:48,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. after waiting 0 ms 2023-07-12 13:40:48,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:40:48,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 912c554550dbcecd943b5e17bf1b23fc 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:48,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/.tmp/colfamily11/25550461cb8d42d5a72f46402a30a652 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/colfamily11/25550461cb8d42d5a72f46402a30a652 2023-07-12 13:40:48,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/colfamily11/25550461cb8d42d5a72f46402a30a652, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:48,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for fd43ad19523fd1e39bad44724f1ef3da in 43ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:48,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/.tmp/colfamily11/b4a5ea39ed80486ca775619fa2825b9c 2023-07-12 13:40:48,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fd43ad19523fd1e39bad44724f1ef3da/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:48,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:40:48,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for fd43ad19523fd1e39bad44724f1ef3da: 2023-07-12 13:40:48,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689169092267.fd43ad19523fd1e39bad44724f1ef3da. 2023-07-12 13:40:48,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 674f5b2fb0eacd68f031d75fb1103b80, disabling compactions & flushes 2023-07-12 13:40:48,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:40:48,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:40:48,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. after waiting 0 ms 2023-07-12 13:40:48,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:40:48,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/.tmp/colfamily11/b4a5ea39ed80486ca775619fa2825b9c as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/colfamily11/b4a5ea39ed80486ca775619fa2825b9c 2023-07-12 13:40:48,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/674f5b2fb0eacd68f031d75fb1103b80/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 13:40:48,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:40:48,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 674f5b2fb0eacd68f031d75fb1103b80: 2023-07-12 13:40:48,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689169092267.674f5b2fb0eacd68f031d75fb1103b80. 2023-07-12 13:40:48,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 5c50497f7f74f39b808201e941fd8963, disabling compactions & flushes 2023-07-12 13:40:48,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:40:48,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:40:48,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. after waiting 0 ms 2023-07-12 13:40:48,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:40:48,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 5c50497f7f74f39b808201e941fd8963 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:48,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/colfamily11/b4a5ea39ed80486ca775619fa2825b9c, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:48,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 912c554550dbcecd943b5e17bf1b23fc in 47ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:48,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/912c554550dbcecd943b5e17bf1b23fc/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:48,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:40:48,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 912c554550dbcecd943b5e17bf1b23fc: 2023-07-12 13:40:48,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689169092267.912c554550dbcecd943b5e17bf1b23fc. 2023-07-12 13:40:48,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 98e8c1a65ac96e53d5bdaf4943cf497a, disabling compactions & flushes 2023-07-12 13:40:48,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:40:48,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:40:48,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. after waiting 0 ms 2023-07-12 13:40:48,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:40:48,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 98e8c1a65ac96e53d5bdaf4943cf497a 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:48,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/.tmp/colfamily11/8cbee27c412540bd8dedb8c3af4f7e2d 2023-07-12 13:40:48,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/.tmp/colfamily11/8cbee27c412540bd8dedb8c3af4f7e2d as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/colfamily11/8cbee27c412540bd8dedb8c3af4f7e2d 2023-07-12 13:40:48,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/.tmp/colfamily11/d6505923ce814e6b8079c7f6ce8e5391 2023-07-12 13:40:48,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/colfamily11/8cbee27c412540bd8dedb8c3af4f7e2d, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:48,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 5c50497f7f74f39b808201e941fd8963 in 53ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:48,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/.tmp/colfamily11/d6505923ce814e6b8079c7f6ce8e5391 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/colfamily11/d6505923ce814e6b8079c7f6ce8e5391 2023-07-12 13:40:48,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5c50497f7f74f39b808201e941fd8963/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:48,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:40:48,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 5c50497f7f74f39b808201e941fd8963: 2023-07-12 13:40:48,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689169092267.5c50497f7f74f39b808201e941fd8963. 2023-07-12 13:40:48,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 5140a4a30c94e149363cee692772d310, disabling compactions & flushes 2023-07-12 13:40:48,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:40:48,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:40:48,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. after waiting 0 ms 2023-07-12 13:40:48,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:40:48,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5140a4a30c94e149363cee692772d310/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 13:40:48,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:40:48,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 5140a4a30c94e149363cee692772d310: 2023-07-12 13:40:48,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689169092267.5140a4a30c94e149363cee692772d310. 2023-07-12 13:40:48,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e3b643504d1d8a33902c66ba6c8a69fd, disabling compactions & flushes 2023-07-12 13:40:48,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/colfamily11/d6505923ce814e6b8079c7f6ce8e5391, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:48,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:40:48,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:40:48,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. after waiting 0 ms 2023-07-12 13:40:48,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:40:48,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing e3b643504d1d8a33902c66ba6c8a69fd 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:48,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 98e8c1a65ac96e53d5bdaf4943cf497a in 53ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:48,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98e8c1a65ac96e53d5bdaf4943cf497a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:48,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:40:48,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 98e8c1a65ac96e53d5bdaf4943cf497a: 2023-07-12 13:40:48,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689169092267.98e8c1a65ac96e53d5bdaf4943cf497a. 2023-07-12 13:40:48,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 216faae9d032640dca24ddf65ab9f909, disabling compactions & flushes 2023-07-12 13:40:48,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:40:48,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:40:48,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. after waiting 0 ms 2023-07-12 13:40:48,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:40:48,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 216faae9d032640dca24ddf65ab9f909 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:48,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/.tmp/colfamily11/fbce70f71fb54fb5a545793127ddac51 2023-07-12 13:40:48,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/.tmp/colfamily11/821e5471fa4143bfbf74c91d12a00676 2023-07-12 13:40:48,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/.tmp/colfamily11/fbce70f71fb54fb5a545793127ddac51 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/colfamily11/fbce70f71fb54fb5a545793127ddac51 2023-07-12 13:40:48,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/.tmp/colfamily11/821e5471fa4143bfbf74c91d12a00676 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/colfamily11/821e5471fa4143bfbf74c91d12a00676 2023-07-12 13:40:48,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/colfamily11/fbce70f71fb54fb5a545793127ddac51, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:48,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for e3b643504d1d8a33902c66ba6c8a69fd in 37ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:48,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/colfamily11/821e5471fa4143bfbf74c91d12a00676, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:48,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 216faae9d032640dca24ddf65ab9f909 in 35ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:48,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e3b643504d1d8a33902c66ba6c8a69fd/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:48,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:40:48,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e3b643504d1d8a33902c66ba6c8a69fd: 2023-07-12 13:40:48,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689169092267.e3b643504d1d8a33902c66ba6c8a69fd. 2023-07-12 13:40:48,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e303901740e4d02964c49fa9d2b7f856, disabling compactions & flushes 2023-07-12 13:40:48,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:40:48,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:40:48,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. after waiting 0 ms 2023-07-12 13:40:48,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:40:48,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing e303901740e4d02964c49fa9d2b7f856 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 13:40:48,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/216faae9d032640dca24ddf65ab9f909/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:48,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:40:48,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 216faae9d032640dca24ddf65ab9f909: 2023-07-12 13:40:48,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689169092267.216faae9d032640dca24ddf65ab9f909. 2023-07-12 13:40:48,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 20ad56ffb65cb5bab6d1f89dc701d381, disabling compactions & flushes 2023-07-12 13:40:48,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:40:48,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:40:48,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. after waiting 0 ms 2023-07-12 13:40:48,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:40:48,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 20ad56ffb65cb5bab6d1f89dc701d381 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:48,177 DEBUG [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1504): Waiting on 260e260b05fbc83a4eb4ced4fbf3a9d8, 736207afd3173343fa3290362bfa994d, e303901740e4d02964c49fa9d2b7f856 2023-07-12 13:40:48,177 DEBUG [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1504): Waiting on 06b18c3992cc931e8054a4dcc480ece1, 20ad56ffb65cb5bab6d1f89dc701d381, f9e1981fea95432fc8fb92eb7cc4524d 2023-07-12 13:40:48,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/.tmp/colfamily11/b45fbcb7163844d99f1576d5698ea976 2023-07-12 13:40:48,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856/.tmp/info/cd68e83839bd44e085ba36083532fde3 2023-07-12 13:40:48,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/.tmp/colfamily11/b45fbcb7163844d99f1576d5698ea976 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/colfamily11/b45fbcb7163844d99f1576d5698ea976 2023-07-12 13:40:48,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856/.tmp/info/cd68e83839bd44e085ba36083532fde3 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856/info/cd68e83839bd44e085ba36083532fde3 2023-07-12 13:40:48,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/colfamily11/b45fbcb7163844d99f1576d5698ea976, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:48,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 20ad56ffb65cb5bab6d1f89dc701d381 in 37ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:48,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856/info/cd68e83839bd44e085ba36083532fde3, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 13:40:48,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e303901740e4d02964c49fa9d2b7f856 in 48ms, sequenceid=6, compaction requested=false 2023-07-12 13:40:48,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/20ad56ffb65cb5bab6d1f89dc701d381/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:48,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:40:48,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 20ad56ffb65cb5bab6d1f89dc701d381: 2023-07-12 13:40:48,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689169092267.20ad56ffb65cb5bab6d1f89dc701d381. 2023-07-12 13:40:48,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 06b18c3992cc931e8054a4dcc480ece1, disabling compactions & flushes 2023-07-12 13:40:48,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:40:48,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:40:48,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. after waiting 0 ms 2023-07-12 13:40:48,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:40:48,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/hbase/namespace/e303901740e4d02964c49fa9d2b7f856/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 13:40:48,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:40:48,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e303901740e4d02964c49fa9d2b7f856: 2023-07-12 13:40:48,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689169091433.e303901740e4d02964c49fa9d2b7f856. 2023-07-12 13:40:48,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 260e260b05fbc83a4eb4ced4fbf3a9d8, disabling compactions & flushes 2023-07-12 13:40:48,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:40:48,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:40:48,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. after waiting 0 ms 2023-07-12 13:40:48,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:40:48,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 260e260b05fbc83a4eb4ced4fbf3a9d8 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:48,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/06b18c3992cc931e8054a4dcc480ece1/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 13:40:48,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:40:48,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 06b18c3992cc931e8054a4dcc480ece1: 2023-07-12 13:40:48,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689169092267.06b18c3992cc931e8054a4dcc480ece1. 2023-07-12 13:40:48,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing f9e1981fea95432fc8fb92eb7cc4524d, disabling compactions & flushes 2023-07-12 13:40:48,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:40:48,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:40:48,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. after waiting 0 ms 2023-07-12 13:40:48,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:40:48,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing f9e1981fea95432fc8fb92eb7cc4524d 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-12 13:40:48,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/.tmp/colfamily11/e010b358a9534bbdb42ce42c3698da8b 2023-07-12 13:40:48,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/.tmp/colfamily11/77de77d196214164a233d1c43f23bdcb 2023-07-12 13:40:48,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/.tmp/colfamily11/e010b358a9534bbdb42ce42c3698da8b as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/colfamily11/e010b358a9534bbdb42ce42c3698da8b 2023-07-12 13:40:48,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/.tmp/colfamily11/77de77d196214164a233d1c43f23bdcb as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/colfamily11/77de77d196214164a233d1c43f23bdcb 2023-07-12 13:40:48,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/colfamily11/e010b358a9534bbdb42ce42c3698da8b, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:48,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/colfamily11/77de77d196214164a233d1c43f23bdcb, entries=703, sequenceid=5, filesize=38.2 K 2023-07-12 13:40:48,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 260e260b05fbc83a4eb4ced4fbf3a9d8 in 33ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:48,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for f9e1981fea95432fc8fb92eb7cc4524d in 31ms, sequenceid=5, compaction requested=false 2023-07-12 13:40:48,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/260e260b05fbc83a4eb4ced4fbf3a9d8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:48,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f9e1981fea95432fc8fb92eb7cc4524d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 13:40:48,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:40:48,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:40:48,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 260e260b05fbc83a4eb4ced4fbf3a9d8: 2023-07-12 13:40:48,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for f9e1981fea95432fc8fb92eb7cc4524d: 2023-07-12 13:40:48,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689169092267.260e260b05fbc83a4eb4ced4fbf3a9d8. 2023-07-12 13:40:48,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689169092267.f9e1981fea95432fc8fb92eb7cc4524d. 2023-07-12 13:40:48,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 736207afd3173343fa3290362bfa994d, disabling compactions & flushes 2023-07-12 13:40:48,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:40:48,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:40:48,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. after waiting 0 ms 2023-07-12 13:40:48,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:40:48,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/736207afd3173343fa3290362bfa994d/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-12 13:40:48,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:40:48,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 736207afd3173343fa3290362bfa994d: 2023-07-12 13:40:48,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689169092267.736207afd3173343fa3290362bfa994d. 2023-07-12 13:40:48,377 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,35445,1689169089256; all regions closed. 2023-07-12 13:40:48,377 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,34091,1689169089223; all regions closed. 2023-07-12 13:40:48,385 DEBUG [RS:1;jenkins-hbase17:34091] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/oldWALs 2023-07-12 13:40:48,385 DEBUG [RS:2;jenkins-hbase17:35445] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/oldWALs 2023-07-12 13:40:48,385 INFO [RS:1;jenkins-hbase17:34091] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C34091%2C1689169089223:(num 1689169090851) 2023-07-12 13:40:48,385 INFO [RS:2;jenkins-hbase17:35445] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C35445%2C1689169089256.meta:.meta(num 1689169243249) 2023-07-12 13:40:48,385 DEBUG [RS:1;jenkins-hbase17:34091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:40:48,385 INFO [RS:1;jenkins-hbase17:34091] regionserver.LeaseManager(133): Closed leases 2023-07-12 13:40:48,386 INFO [RS:1;jenkins-hbase17:34091] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 13:40:48,386 INFO [RS:1;jenkins-hbase17:34091] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 13:40:48,386 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 13:40:48,386 INFO [RS:1;jenkins-hbase17:34091] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 13:40:48,386 INFO [RS:1;jenkins-hbase17:34091] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 13:40:48,387 INFO [RS:1;jenkins-hbase17:34091] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:34091 2023-07-12 13:40:48,390 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:48,390 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:40:48,390 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:40:48,390 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,34091,1689169089223 2023-07-12 13:40:48,390 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:40:48,391 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,34091,1689169089223] 2023-07-12 13:40:48,392 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,34091,1689169089223; numProcessing=1 2023-07-12 13:40:48,392 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,34091,1689169089223 already deleted, retry=false 2023-07-12 13:40:48,392 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,34091,1689169089223 expired; onlineServers=1 2023-07-12 13:40:48,393 DEBUG [RS:2;jenkins-hbase17:35445] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/oldWALs 2023-07-12 13:40:48,393 INFO [RS:2;jenkins-hbase17:35445] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C35445%2C1689169089256:(num 1689169090851) 2023-07-12 13:40:48,393 DEBUG [RS:2;jenkins-hbase17:35445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:40:48,393 INFO [RS:2;jenkins-hbase17:35445] regionserver.LeaseManager(133): Closed leases 2023-07-12 13:40:48,393 INFO [RS:2;jenkins-hbase17:35445] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 13:40:48,394 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 13:40:48,395 INFO [RS:2;jenkins-hbase17:35445] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:35445 2023-07-12 13:40:48,397 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 13:40:48,397 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35445,1689169089256 2023-07-12 13:40:48,399 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,35445,1689169089256] 2023-07-12 13:40:48,399 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,35445,1689169089256; numProcessing=2 2023-07-12 13:40:48,399 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,35445,1689169089256 already deleted, retry=false 2023-07-12 13:40:48,399 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,35445,1689169089256 expired; onlineServers=0 2023-07-12 13:40:48,399 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,42137,1689169087924' ***** 2023-07-12 13:40:48,400 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 13:40:48,400 DEBUG [M:0;jenkins-hbase17:42137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bf790de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-12 13:40:48,400 INFO [M:0;jenkins-hbase17:42137] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,42137,1689169087924 2023-07-12 13:40:48,400 INFO [M:0;jenkins-hbase17:42137] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,42137,1689169087924; all regions closed. 2023-07-12 13:40:48,400 DEBUG [M:0;jenkins-hbase17:42137] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 13:40:48,400 DEBUG [M:0;jenkins-hbase17:42137] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 13:40:48,401 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 13:40:48,401 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689169090491] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689169090491,5,FailOnTimeoutGroup] 2023-07-12 13:40:48,401 DEBUG [M:0;jenkins-hbase17:42137] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 13:40:48,401 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689169090492] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689169090492,5,FailOnTimeoutGroup] 2023-07-12 13:40:48,402 INFO [M:0;jenkins-hbase17:42137] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 13:40:48,402 INFO [M:0;jenkins-hbase17:42137] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 13:40:48,402 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 13:40:48,402 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 13:40:48,402 INFO [M:0;jenkins-hbase17:42137] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-12 13:40:48,403 DEBUG [M:0;jenkins-hbase17:42137] master.HMaster(1512): Stopping service threads 2023-07-12 13:40:48,403 INFO [M:0;jenkins-hbase17:42137] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 13:40:48,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 13:40:48,403 ERROR [M:0;jenkins-hbase17:42137] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 13:40:48,403 INFO [M:0;jenkins-hbase17:42137] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 13:40:48,403 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 13:40:48,404 DEBUG [M:0;jenkins-hbase17:42137] zookeeper.ZKUtil(398): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 13:40:48,404 WARN [M:0;jenkins-hbase17:42137] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 13:40:48,404 INFO [M:0;jenkins-hbase17:42137] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 13:40:48,404 INFO [M:0;jenkins-hbase17:42137] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 13:40:48,404 DEBUG [M:0;jenkins-hbase17:42137] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 13:40:48,404 INFO [M:0;jenkins-hbase17:42137] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:40:48,404 DEBUG [M:0;jenkins-hbase17:42137] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:40:48,404 DEBUG [M:0;jenkins-hbase17:42137] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 13:40:48,404 DEBUG [M:0;jenkins-hbase17:42137] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:40:48,404 INFO [M:0;jenkins-hbase17:42137] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=336.97 KB heapSize=392.97 KB 2023-07-12 13:40:48,428 INFO [M:0;jenkins-hbase17:42137] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=336.97 KB at sequenceid=596 (bloomFilter=true), to=hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cc5e7048f90e4d6181c6e61cd0bd3e14 2023-07-12 13:40:48,432 DEBUG [M:0;jenkins-hbase17:42137] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cc5e7048f90e4d6181c6e61cd0bd3e14 as hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cc5e7048f90e4d6181c6e61cd0bd3e14 2023-07-12 13:40:48,437 INFO [M:0;jenkins-hbase17:42137] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43791/user/jenkins/test-data/fee5a041-dad3-11fe-ae76-0c5b3f039ca9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cc5e7048f90e4d6181c6e61cd0bd3e14, entries=86, sequenceid=596, filesize=14.2 K 2023-07-12 13:40:48,438 INFO [M:0;jenkins-hbase17:42137] regionserver.HRegion(2948): Finished flush of dataSize ~336.97 KB/345059, heapSize ~392.95 KB/402384, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 34ms, sequenceid=596, compaction requested=false 2023-07-12 13:40:48,439 INFO [M:0;jenkins-hbase17:42137] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 13:40:48,439 DEBUG [M:0;jenkins-hbase17:42137] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 13:40:48,444 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 13:40:48,444 INFO [M:0;jenkins-hbase17:42137] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 13:40:48,444 INFO [M:0;jenkins-hbase17:42137] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:42137 2023-07-12 13:40:48,446 DEBUG [M:0;jenkins-hbase17:42137] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,42137,1689169087924 already deleted, retry=false 2023-07-12 13:40:48,492 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:40:48,492 INFO [RS:1;jenkins-hbase17:34091] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,34091,1689169089223; zookeeper connection closed. 2023-07-12 13:40:48,492 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:34091-0x10159c043900002, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:40:48,492 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2cf968b6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2cf968b6 2023-07-12 13:40:48,592 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:40:48,592 INFO [M:0;jenkins-hbase17:42137] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,42137,1689169087924; zookeeper connection closed. 2023-07-12 13:40:48,592 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): master:42137-0x10159c043900000, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:40:48,692 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:40:48,692 INFO [RS:2;jenkins-hbase17:35445] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,35445,1689169089256; zookeeper connection closed. 2023-07-12 13:40:48,692 DEBUG [Listener at localhost.localdomain/40361-EventThread] zookeeper.ZKWatcher(600): regionserver:35445-0x10159c043900003, quorum=127.0.0.1:56143, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 13:40:48,693 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@337f4f33] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@337f4f33 2023-07-12 13:40:48,693 INFO [Listener at localhost.localdomain/40361] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 13:40:48,694 WARN [Listener at localhost.localdomain/40361] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 13:40:48,699 INFO [Listener at localhost.localdomain/40361] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 13:40:48,807 WARN [BP-2102686798-136.243.18.41-1689169081637 heartbeating to localhost.localdomain/127.0.0.1:43791] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 13:40:48,807 WARN [BP-2102686798-136.243.18.41-1689169081637 heartbeating to localhost.localdomain/127.0.0.1:43791] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2102686798-136.243.18.41-1689169081637 (Datanode Uuid 4a662cde-b7d6-4b53-8fec-ac6f9be1e65c) service to localhost.localdomain/127.0.0.1:43791 2023-07-12 13:40:48,809 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/cluster_3e57dbce-1243-5245-5db7-0568de051540/dfs/data/data5/current/BP-2102686798-136.243.18.41-1689169081637] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 13:40:48,809 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/cluster_3e57dbce-1243-5245-5db7-0568de051540/dfs/data/data6/current/BP-2102686798-136.243.18.41-1689169081637] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 13:40:48,811 WARN [Listener at localhost.localdomain/40361] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 13:40:48,814 INFO [Listener at localhost.localdomain/40361] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 13:40:48,830 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-12 13:40:48,923 WARN [BP-2102686798-136.243.18.41-1689169081637 heartbeating to localhost.localdomain/127.0.0.1:43791] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 13:40:48,923 WARN [BP-2102686798-136.243.18.41-1689169081637 heartbeating to localhost.localdomain/127.0.0.1:43791] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2102686798-136.243.18.41-1689169081637 (Datanode Uuid 0d3c2b17-d056-4e6b-9464-9758b120b6cb) service to localhost.localdomain/127.0.0.1:43791 2023-07-12 13:40:48,924 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/cluster_3e57dbce-1243-5245-5db7-0568de051540/dfs/data/data3/current/BP-2102686798-136.243.18.41-1689169081637] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 13:40:48,925 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/cluster_3e57dbce-1243-5245-5db7-0568de051540/dfs/data/data4/current/BP-2102686798-136.243.18.41-1689169081637] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 13:40:48,927 WARN [Listener at localhost.localdomain/40361] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 13:40:48,931 INFO [Listener at localhost.localdomain/40361] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 13:40:49,040 WARN [BP-2102686798-136.243.18.41-1689169081637 heartbeating to localhost.localdomain/127.0.0.1:43791] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 13:40:49,040 WARN [BP-2102686798-136.243.18.41-1689169081637 heartbeating to localhost.localdomain/127.0.0.1:43791] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2102686798-136.243.18.41-1689169081637 (Datanode Uuid ad128a13-2207-44e4-876a-b304c8dfdccd) service to localhost.localdomain/127.0.0.1:43791 2023-07-12 13:40:49,041 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/cluster_3e57dbce-1243-5245-5db7-0568de051540/dfs/data/data1/current/BP-2102686798-136.243.18.41-1689169081637] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 13:40:49,041 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e3fde90d-a2e4-fcb7-eeaf-3976f72f2c53/cluster_3e57dbce-1243-5245-5db7-0568de051540/dfs/data/data2/current/BP-2102686798-136.243.18.41-1689169081637] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 13:40:49,076 INFO [Listener at localhost.localdomain/40361] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-12 13:40:49,202 INFO [Listener at localhost.localdomain/40361] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 13:40:49,283 INFO [Listener at localhost.localdomain/40361] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-12 13:40:49,298 INFO [Listener at localhost.localdomain/40361] hbase.ResourceChecker(175): after: master.procedure.TestSCPWithMeta#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=76 (was 9) Potentially hanging thread: ReplicationExecutor-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (28310089) connection to localhost.localdomain/127.0.0.1:43791 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@5309626e java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (28310089) connection to localhost.localdomain/127.0.0.1:43791 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase17:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost.localdomain:43791 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase17:39081Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/40361 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Abort regionserver monitor java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (28310089) connection to localhost.localdomain/127.0.0.1:43791 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: regionserver/jenkins-hbase17:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-5-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase17:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase17:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_META-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase17:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: regionserver/jenkins-hbase17:0.logRoller java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.wal.AbstractWALRoller.run(AbstractWALRoller.java:179) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Parameter Sending Thread #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost.localdomain:43791 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (28310089) connection to localhost.localdomain/127.0.0.1:43791 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:43791 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase17:0.Chore.1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=555 (was 256) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=503 (was 476) - SystemLoadAverage LEAK? -, ProcessCount=177 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=2293 (was 3807)