2023-07-11 18:05:01,227 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta timeout: 13 mins 2023-07-11 18:05:01,230 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.procedure.TestSCPWithMetaWithoutZKCoordinated timeout: 13 mins 2023-07-11 18:05:01,268 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.procedure.TestSCPWithMetaWithoutZKCoordinated#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=9, OpenFileDescriptor=256, MaxFileDescriptor=60000, SystemLoadAverage=190, ProcessCount=172, AvailableMemoryMB=9119 2023-07-11 18:05:01,520 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848 2023-07-11 18:05:01,524 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 18:05:01,524 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/cluster_23be2bdb-296d-eb19-651b-53674de03faf, deleteOnExit=true 2023-07-11 18:05:01,524 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 18:05:01,525 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/test.cache.data in system properties and HBase conf 2023-07-11 18:05:01,525 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 18:05:01,526 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/hadoop.log.dir in system properties and HBase conf 2023-07-11 18:05:01,526 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 18:05:01,526 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 18:05:01,526 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 18:05:01,631 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 18:05:01,997 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 18:05:02,002 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 18:05:02,002 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 18:05:02,003 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 18:05:02,003 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 18:05:02,004 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 18:05:02,004 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 18:05:02,005 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 18:05:02,005 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 18:05:02,006 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 18:05:02,006 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/nfs.dump.dir in system properties and HBase conf 2023-07-11 18:05:02,007 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/java.io.tmpdir in system properties and HBase conf 2023-07-11 18:05:02,007 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 18:05:02,007 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 18:05:02,008 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 18:05:02,502 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 18:05:02,507 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 18:05:02,779 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 18:05:02,922 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 18:05:02,936 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 18:05:02,972 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 18:05:03,003 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/java.io.tmpdir/Jetty_localhost_42461_hdfs____mmchuj/webapp 2023-07-11 18:05:03,155 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42461 2023-07-11 18:05:03,165 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 18:05:03,165 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 18:05:03,584 WARN [Listener at localhost/36175] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 18:05:03,657 WARN [Listener at localhost/36175] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 18:05:03,677 WARN [Listener at localhost/36175] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 18:05:03,683 INFO [Listener at localhost/36175] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 18:05:03,688 INFO [Listener at localhost/36175] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/java.io.tmpdir/Jetty_localhost_41757_datanode____wf2yjn/webapp 2023-07-11 18:05:03,790 INFO [Listener at localhost/36175] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41757 2023-07-11 18:05:04,120 WARN [Listener at localhost/38155] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 18:05:04,130 WARN [Listener at localhost/38155] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 18:05:04,135 WARN [Listener at localhost/38155] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 18:05:04,137 INFO [Listener at localhost/38155] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 18:05:04,144 INFO [Listener at localhost/38155] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/java.io.tmpdir/Jetty_localhost_38459_datanode____8httiy/webapp 2023-07-11 18:05:04,250 INFO [Listener at localhost/38155] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38459 2023-07-11 18:05:04,259 WARN [Listener at localhost/40969] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 18:05:04,272 WARN [Listener at localhost/40969] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 18:05:04,276 WARN [Listener at localhost/40969] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 18:05:04,278 INFO [Listener at localhost/40969] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 18:05:04,283 INFO [Listener at localhost/40969] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/java.io.tmpdir/Jetty_localhost_44523_datanode____1pth25/webapp 2023-07-11 18:05:04,410 INFO [Listener at localhost/40969] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44523 2023-07-11 18:05:04,419 WARN [Listener at localhost/46025] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 18:05:04,595 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcae140cbde67767e: Processing first storage report for DS-b9c5174f-b457-40ad-aaac-7080e57eaa67 from datanode edbd87bc-6a9e-43b8-a999-1f2b06c0eda4 2023-07-11 18:05:04,597 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcae140cbde67767e: from storage DS-b9c5174f-b457-40ad-aaac-7080e57eaa67 node DatanodeRegistration(127.0.0.1:46059, datanodeUuid=edbd87bc-6a9e-43b8-a999-1f2b06c0eda4, infoPort=34041, infoSecurePort=0, ipcPort=38155, storageInfo=lv=-57;cid=testClusterID;nsid=450618830;c=1689098702578), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-11 18:05:04,597 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x468b2958f8c1d746: Processing first storage report for DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe from datanode 9c0a647b-308a-487e-994a-e76bed2bc8f8 2023-07-11 18:05:04,597 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x468b2958f8c1d746: from storage DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe node DatanodeRegistration(127.0.0.1:41785, datanodeUuid=9c0a647b-308a-487e-994a-e76bed2bc8f8, infoPort=40207, infoSecurePort=0, ipcPort=40969, storageInfo=lv=-57;cid=testClusterID;nsid=450618830;c=1689098702578), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 18:05:04,597 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf04edd6a0cc996aa: Processing first storage report for DS-e9d8e264-1deb-4f74-8b66-90c71c14742b from datanode c85e490d-5517-4ca1-b5e6-4ac751a4880c 2023-07-11 18:05:04,597 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf04edd6a0cc996aa: from storage DS-e9d8e264-1deb-4f74-8b66-90c71c14742b node DatanodeRegistration(127.0.0.1:39225, datanodeUuid=c85e490d-5517-4ca1-b5e6-4ac751a4880c, infoPort=43495, infoSecurePort=0, ipcPort=46025, storageInfo=lv=-57;cid=testClusterID;nsid=450618830;c=1689098702578), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 18:05:04,598 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcae140cbde67767e: Processing first storage report for DS-f10ce6c2-39dc-45c0-8052-2efbe4ffbd2d from datanode edbd87bc-6a9e-43b8-a999-1f2b06c0eda4 2023-07-11 18:05:04,598 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcae140cbde67767e: from storage DS-f10ce6c2-39dc-45c0-8052-2efbe4ffbd2d node DatanodeRegistration(127.0.0.1:46059, datanodeUuid=edbd87bc-6a9e-43b8-a999-1f2b06c0eda4, infoPort=34041, infoSecurePort=0, ipcPort=38155, storageInfo=lv=-57;cid=testClusterID;nsid=450618830;c=1689098702578), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 18:05:04,598 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x468b2958f8c1d746: Processing first storage report for DS-1346d994-ee99-4934-853d-e1c01318554e from datanode 9c0a647b-308a-487e-994a-e76bed2bc8f8 2023-07-11 18:05:04,598 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x468b2958f8c1d746: from storage DS-1346d994-ee99-4934-853d-e1c01318554e node DatanodeRegistration(127.0.0.1:41785, datanodeUuid=9c0a647b-308a-487e-994a-e76bed2bc8f8, infoPort=40207, infoSecurePort=0, ipcPort=40969, storageInfo=lv=-57;cid=testClusterID;nsid=450618830;c=1689098702578), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 18:05:04,598 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf04edd6a0cc996aa: Processing first storage report for DS-6ca2f39f-026f-42a3-b2a5-4d3bb193fe7c from datanode c85e490d-5517-4ca1-b5e6-4ac751a4880c 2023-07-11 18:05:04,598 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf04edd6a0cc996aa: from storage DS-6ca2f39f-026f-42a3-b2a5-4d3bb193fe7c node DatanodeRegistration(127.0.0.1:39225, datanodeUuid=c85e490d-5517-4ca1-b5e6-4ac751a4880c, infoPort=43495, infoSecurePort=0, ipcPort=46025, storageInfo=lv=-57;cid=testClusterID;nsid=450618830;c=1689098702578), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 18:05:04,817 DEBUG [Listener at localhost/46025] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848 2023-07-11 18:05:04,892 INFO [Listener at localhost/46025] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/cluster_23be2bdb-296d-eb19-651b-53674de03faf/zookeeper_0, clientPort=56404, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/cluster_23be2bdb-296d-eb19-651b-53674de03faf/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/cluster_23be2bdb-296d-eb19-651b-53674de03faf/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 18:05:04,906 INFO [Listener at localhost/46025] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56404 2023-07-11 18:05:04,915 INFO [Listener at localhost/46025] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:05:04,917 INFO [Listener at localhost/46025] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:05:05,586 INFO [Listener at localhost/46025] util.FSUtils(471): Created version file at hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc with version=8 2023-07-11 18:05:05,587 INFO [Listener at localhost/46025] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/hbase-staging 2023-07-11 18:05:05,902 INFO [Listener at localhost/46025] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 18:05:06,366 INFO [Listener at localhost/46025] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 18:05:06,398 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:06,398 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:06,399 INFO [Listener at localhost/46025] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 18:05:06,399 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:06,399 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 18:05:06,543 INFO [Listener at localhost/46025] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 18:05:06,627 DEBUG [Listener at localhost/46025] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 18:05:06,744 INFO [Listener at localhost/46025] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35481 2023-07-11 18:05:06,754 INFO [Listener at localhost/46025] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:05:06,756 INFO [Listener at localhost/46025] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:05:06,781 INFO [Listener at localhost/46025] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35481 connecting to ZooKeeper ensemble=127.0.0.1:56404 2023-07-11 18:05:06,822 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:354810x0, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 18:05:06,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35481-0x10155819b8c0000 connected 2023-07-11 18:05:06,864 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:05:06,865 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:05:06,869 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 18:05:06,879 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35481 2023-07-11 18:05:06,880 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35481 2023-07-11 18:05:06,882 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35481 2023-07-11 18:05:06,882 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35481 2023-07-11 18:05:06,882 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35481 2023-07-11 18:05:06,889 INFO [Listener at localhost/46025] master.HMaster(444): hbase.rootdir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc, hbase.cluster.distributed=false 2023-07-11 18:05:06,959 INFO [Listener at localhost/46025] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 18:05:06,959 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:06,960 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:06,960 INFO [Listener at localhost/46025] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 18:05:06,960 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:06,960 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 18:05:06,965 INFO [Listener at localhost/46025] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 18:05:06,968 INFO [Listener at localhost/46025] ipc.NettyRpcServer(120): Bind to /172.31.2.10:38785 2023-07-11 18:05:06,971 INFO [Listener at localhost/46025] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 18:05:06,978 DEBUG [Listener at localhost/46025] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 18:05:06,980 INFO [Listener at localhost/46025] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:05:06,981 INFO [Listener at localhost/46025] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:05:06,984 INFO [Listener at localhost/46025] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38785 connecting to ZooKeeper ensemble=127.0.0.1:56404 2023-07-11 18:05:06,988 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:387850x0, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 18:05:06,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38785-0x10155819b8c0001 connected 2023-07-11 18:05:06,989 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:05:06,991 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:05:06,992 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 18:05:06,993 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38785 2023-07-11 18:05:06,996 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38785 2023-07-11 18:05:06,996 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38785 2023-07-11 18:05:06,997 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38785 2023-07-11 18:05:06,997 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38785 2023-07-11 18:05:07,011 INFO [Listener at localhost/46025] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 18:05:07,011 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:07,012 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:07,012 INFO [Listener at localhost/46025] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 18:05:07,013 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:07,013 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 18:05:07,013 INFO [Listener at localhost/46025] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 18:05:07,016 INFO [Listener at localhost/46025] ipc.NettyRpcServer(120): Bind to /172.31.2.10:33801 2023-07-11 18:05:07,017 INFO [Listener at localhost/46025] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 18:05:07,018 DEBUG [Listener at localhost/46025] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 18:05:07,019 INFO [Listener at localhost/46025] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:05:07,022 INFO [Listener at localhost/46025] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:05:07,023 INFO [Listener at localhost/46025] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33801 connecting to ZooKeeper ensemble=127.0.0.1:56404 2023-07-11 18:05:07,033 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:338010x0, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 18:05:07,034 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): regionserver:338010x0, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:05:07,035 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): regionserver:338010x0, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:05:07,036 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): regionserver:338010x0, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 18:05:07,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33801-0x10155819b8c0002 connected 2023-07-11 18:05:07,042 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33801 2023-07-11 18:05:07,046 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33801 2023-07-11 18:05:07,046 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33801 2023-07-11 18:05:07,048 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33801 2023-07-11 18:05:07,049 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33801 2023-07-11 18:05:07,062 INFO [Listener at localhost/46025] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 18:05:07,063 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:07,063 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:07,063 INFO [Listener at localhost/46025] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 18:05:07,063 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:05:07,063 INFO [Listener at localhost/46025] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 18:05:07,063 INFO [Listener at localhost/46025] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 18:05:07,065 INFO [Listener at localhost/46025] ipc.NettyRpcServer(120): Bind to /172.31.2.10:36619 2023-07-11 18:05:07,065 INFO [Listener at localhost/46025] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 18:05:07,069 DEBUG [Listener at localhost/46025] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 18:05:07,071 INFO [Listener at localhost/46025] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:05:07,073 INFO [Listener at localhost/46025] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:05:07,075 INFO [Listener at localhost/46025] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36619 connecting to ZooKeeper ensemble=127.0.0.1:56404 2023-07-11 18:05:07,080 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:366190x0, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 18:05:07,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36619-0x10155819b8c0003 connected 2023-07-11 18:05:07,082 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:05:07,082 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:05:07,083 DEBUG [Listener at localhost/46025] zookeeper.ZKUtil(164): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 18:05:07,086 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36619 2023-07-11 18:05:07,089 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36619 2023-07-11 18:05:07,090 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36619 2023-07-11 18:05:07,090 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36619 2023-07-11 18:05:07,091 DEBUG [Listener at localhost/46025] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36619 2023-07-11 18:05:07,098 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,35481,1689098705729 2023-07-11 18:05:07,108 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 18:05:07,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,35481,1689098705729 2023-07-11 18:05:07,127 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:05:07,127 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:05:07,127 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:05:07,127 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:05:07,128 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:05:07,129 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 18:05:07,131 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,35481,1689098705729 from backup master directory 2023-07-11 18:05:07,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 18:05:07,135 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,35481,1689098705729 2023-07-11 18:05:07,135 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 18:05:07,136 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 18:05:07,136 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,35481,1689098705729 2023-07-11 18:05:07,139 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 18:05:07,140 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 18:05:07,241 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/hbase.id with ID: c99e391f-8b2f-4442-9945-2b4c9cb87114 2023-07-11 18:05:07,293 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:05:07,309 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:05:07,389 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2619c11d to 127.0.0.1:56404 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:05:07,433 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3363f0ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:05:07,456 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:05:07,458 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 18:05:07,475 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 18:05:07,476 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 18:05:07,477 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:07,482 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:07,483 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:05:07,519 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/data/master/store-tmp 2023-07-11 18:05:07,566 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:07,567 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 18:05:07,567 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:05:07,567 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:05:07,567 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 18:05:07,567 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:05:07,567 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:05:07,567 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 18:05:07,569 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/WALs/jenkins-hbase9.apache.org,35481,1689098705729 2023-07-11 18:05:07,589 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35481%2C1689098705729, suffix=, logDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/WALs/jenkins-hbase9.apache.org,35481,1689098705729, archiveDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/oldWALs, maxLogs=10 2023-07-11 18:05:07,644 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK] 2023-07-11 18:05:07,644 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK] 2023-07-11 18:05:07,644 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK] 2023-07-11 18:05:07,654 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:07,727 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/WALs/jenkins-hbase9.apache.org,35481,1689098705729/jenkins-hbase9.apache.org%2C35481%2C1689098705729.1689098707599 2023-07-11 18:05:07,728 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK], DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK], DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK]] 2023-07-11 18:05:07,729 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:05:07,729 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:07,732 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:05:07,733 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:05:07,797 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:05:07,806 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 18:05:07,839 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 18:05:07,850 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:07,857 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:05:07,859 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:05:07,874 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:05:07,879 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:07,880 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62490468, jitterRate=-0.06881946325302124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:05:07,880 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 18:05:07,882 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 18:05:07,903 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 18:05:07,903 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 18:05:07,906 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:05:07,908 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 18:05:07,942 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-07-11 18:05:07,942 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 18:05:07,974 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 18:05:07,981 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 18:05:08,016 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 18:05:08,021 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 18:05:08,023 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 18:05:08,030 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 18:05:08,036 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 18:05:08,040 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:05:08,044 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 18:05:08,045 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 18:05:08,060 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 18:05:08,065 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 18:05:08,065 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 18:05:08,065 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 18:05:08,067 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 18:05:08,067 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:05:08,068 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,35481,1689098705729, sessionid=0x10155819b8c0000, setting cluster-up flag (Was=false) 2023-07-11 18:05:08,087 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:05:08,094 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 18:05:08,097 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35481,1689098705729 2023-07-11 18:05:08,103 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:05:08,110 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 18:05:08,111 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35481,1689098705729 2023-07-11 18:05:08,114 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.hbase-snapshot/.tmp 2023-07-11 18:05:08,204 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(951): ClusterId : c99e391f-8b2f-4442-9945-2b4c9cb87114 2023-07-11 18:05:08,205 INFO [RS:0;jenkins-hbase9:38785] regionserver.HRegionServer(951): ClusterId : c99e391f-8b2f-4442-9945-2b4c9cb87114 2023-07-11 18:05:08,204 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(951): ClusterId : c99e391f-8b2f-4442-9945-2b4c9cb87114 2023-07-11 18:05:08,212 DEBUG [RS:0;jenkins-hbase9:38785] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 18:05:08,212 DEBUG [RS:1;jenkins-hbase9:33801] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 18:05:08,215 DEBUG [RS:2;jenkins-hbase9:36619] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 18:05:08,220 DEBUG [RS:0;jenkins-hbase9:38785] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 18:05:08,220 DEBUG [RS:2;jenkins-hbase9:36619] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 18:05:08,220 DEBUG [RS:1;jenkins-hbase9:33801] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 18:05:08,220 DEBUG [RS:2;jenkins-hbase9:36619] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 18:05:08,220 DEBUG [RS:0;jenkins-hbase9:38785] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 18:05:08,220 DEBUG [RS:1;jenkins-hbase9:33801] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 18:05:08,225 DEBUG [RS:2;jenkins-hbase9:36619] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 18:05:08,231 DEBUG [RS:1;jenkins-hbase9:33801] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 18:05:08,231 DEBUG [RS:0;jenkins-hbase9:38785] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 18:05:08,231 DEBUG [RS:2;jenkins-hbase9:36619] zookeeper.ReadOnlyZKClient(139): Connect 0x0d87e5ec to 127.0.0.1:56404 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:05:08,232 DEBUG [RS:1;jenkins-hbase9:33801] zookeeper.ReadOnlyZKClient(139): Connect 0x4c9b813c to 127.0.0.1:56404 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:05:08,232 DEBUG [RS:0;jenkins-hbase9:38785] zookeeper.ReadOnlyZKClient(139): Connect 0x6a8349c7 to 127.0.0.1:56404 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:05:08,253 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 18:05:08,260 DEBUG [RS:2;jenkins-hbase9:36619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3401a2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:05:08,261 DEBUG [RS:1;jenkins-hbase9:33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@425c66df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:05:08,261 DEBUG [RS:2;jenkins-hbase9:36619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77f8e9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 18:05:08,261 DEBUG [RS:1;jenkins-hbase9:33801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4663ea4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 18:05:08,262 DEBUG [RS:0;jenkins-hbase9:38785] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6444aae7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:05:08,262 DEBUG [RS:0;jenkins-hbase9:38785] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@607b22b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 18:05:08,265 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:05:08,265 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:05:08,265 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:05:08,265 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:05:08,266 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-11 18:05:08,266 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,266 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 18:05:08,266 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,269 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689098738269 2023-07-11 18:05:08,271 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 18:05:08,276 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 18:05:08,276 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 18:05:08,282 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 18:05:08,284 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 18:05:08,289 DEBUG [RS:0;jenkins-hbase9:38785] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:38785 2023-07-11 18:05:08,290 DEBUG [RS:2;jenkins-hbase9:36619] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:36619 2023-07-11 18:05:08,291 DEBUG [RS:1;jenkins-hbase9:33801] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:33801 2023-07-11 18:05:08,293 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 18:05:08,293 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 18:05:08,293 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 18:05:08,294 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 18:05:08,295 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,295 INFO [RS:2;jenkins-hbase9:36619] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 18:05:08,295 INFO [RS:0;jenkins-hbase9:38785] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 18:05:08,296 INFO [RS:0;jenkins-hbase9:38785] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 18:05:08,295 INFO [RS:1;jenkins-hbase9:33801] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 18:05:08,296 DEBUG [RS:0;jenkins-hbase9:38785] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 18:05:08,296 INFO [RS:2;jenkins-hbase9:36619] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 18:05:08,296 INFO [RS:1;jenkins-hbase9:33801] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 18:05:08,297 DEBUG [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 18:05:08,297 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 18:05:08,297 DEBUG [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 18:05:08,299 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 18:05:08,299 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 18:05:08,300 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35481,1689098705729 with isa=jenkins-hbase9.apache.org/172.31.2.10:33801, startcode=1689098707010 2023-07-11 18:05:08,300 INFO [RS:0;jenkins-hbase9:38785] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35481,1689098705729 with isa=jenkins-hbase9.apache.org/172.31.2.10:38785, startcode=1689098706958 2023-07-11 18:05:08,300 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35481,1689098705729 with isa=jenkins-hbase9.apache.org/172.31.2.10:36619, startcode=1689098707062 2023-07-11 18:05:08,301 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 18:05:08,302 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 18:05:08,304 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689098708303,5,FailOnTimeoutGroup] 2023-07-11 18:05:08,306 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689098708304,5,FailOnTimeoutGroup] 2023-07-11 18:05:08,306 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,306 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 18:05:08,307 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,308 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,335 DEBUG [RS:2;jenkins-hbase9:36619] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:05:08,335 DEBUG [RS:0;jenkins-hbase9:38785] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:05:08,335 DEBUG [RS:1;jenkins-hbase9:33801] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:05:08,344 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 18:05:08,346 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 18:05:08,346 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc 2023-07-11 18:05:08,385 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:08,390 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 18:05:08,393 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/info 2023-07-11 18:05:08,394 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 18:05:08,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:08,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 18:05:08,400 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/rep_barrier 2023-07-11 18:05:08,400 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 18:05:08,401 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:08,402 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 18:05:08,404 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/table 2023-07-11 18:05:08,405 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 18:05:08,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:08,407 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740 2023-07-11 18:05:08,408 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740 2023-07-11 18:05:08,411 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57953, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:05:08,411 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40739, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:05:08,411 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54475, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:05:08,413 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:08,418 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 18:05:08,424 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:08,425 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70045838, jitterRate=0.043764322996139526}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:08,425 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 18:05:08,425 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 18:05:08,425 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 18:05:08,425 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 18:05:08,425 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35481] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:08,425 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 18:05:08,426 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 18:05:08,427 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 18:05:08,427 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 18:05:08,432 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 18:05:08,432 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 18:05:08,439 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35481] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:08,441 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35481] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:08,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 18:05:08,447 DEBUG [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc 2023-07-11 18:05:08,447 DEBUG [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc 2023-07-11 18:05:08,447 DEBUG [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36175 2023-07-11 18:05:08,447 DEBUG [RS:0;jenkins-hbase9:38785] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc 2023-07-11 18:05:08,447 DEBUG [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 18:05:08,447 DEBUG [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36175 2023-07-11 18:05:08,447 DEBUG [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 18:05:08,447 DEBUG [RS:0;jenkins-hbase9:38785] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36175 2023-07-11 18:05:08,448 DEBUG [RS:0;jenkins-hbase9:38785] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 18:05:08,453 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:05:08,459 DEBUG [RS:0;jenkins-hbase9:38785] zookeeper.ZKUtil(162): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:08,459 WARN [RS:0;jenkins-hbase9:38785] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 18:05:08,459 INFO [RS:0;jenkins-hbase9:38785] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:05:08,460 DEBUG [RS:0;jenkins-hbase9:38785] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:08,460 DEBUG [RS:2;jenkins-hbase9:36619] zookeeper.ZKUtil(162): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:08,460 DEBUG [RS:1;jenkins-hbase9:33801] zookeeper.ZKUtil(162): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:08,460 WARN [RS:2;jenkins-hbase9:36619] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 18:05:08,460 WARN [RS:1;jenkins-hbase9:33801] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 18:05:08,461 INFO [RS:2;jenkins-hbase9:36619] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:05:08,462 INFO [RS:1;jenkins-hbase9:33801] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:05:08,462 DEBUG [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:08,462 DEBUG [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:08,462 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,36619,1689098707062] 2023-07-11 18:05:08,462 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,38785,1689098706958] 2023-07-11 18:05:08,462 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,33801,1689098707010] 2023-07-11 18:05:08,474 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 18:05:08,477 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 18:05:08,479 DEBUG [RS:1;jenkins-hbase9:33801] zookeeper.ZKUtil(162): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:08,479 DEBUG [RS:2;jenkins-hbase9:36619] zookeeper.ZKUtil(162): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:08,479 DEBUG [RS:1;jenkins-hbase9:33801] zookeeper.ZKUtil(162): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:08,480 DEBUG [RS:2;jenkins-hbase9:36619] zookeeper.ZKUtil(162): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:08,480 DEBUG [RS:0;jenkins-hbase9:38785] zookeeper.ZKUtil(162): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:08,480 DEBUG [RS:1;jenkins-hbase9:33801] zookeeper.ZKUtil(162): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:08,480 DEBUG [RS:2;jenkins-hbase9:36619] zookeeper.ZKUtil(162): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:08,480 DEBUG [RS:0;jenkins-hbase9:38785] zookeeper.ZKUtil(162): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:08,481 DEBUG [RS:0;jenkins-hbase9:38785] zookeeper.ZKUtil(162): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:08,491 DEBUG [RS:1;jenkins-hbase9:33801] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 18:05:08,491 DEBUG [RS:2;jenkins-hbase9:36619] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 18:05:08,491 DEBUG [RS:0;jenkins-hbase9:38785] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 18:05:08,503 INFO [RS:0;jenkins-hbase9:38785] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 18:05:08,504 INFO [RS:1;jenkins-hbase9:33801] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 18:05:08,503 INFO [RS:2;jenkins-hbase9:36619] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 18:05:08,527 INFO [RS:1;jenkins-hbase9:33801] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 18:05:08,527 INFO [RS:2;jenkins-hbase9:36619] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 18:05:08,528 INFO [RS:0;jenkins-hbase9:38785] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 18:05:08,536 INFO [RS:1;jenkins-hbase9:33801] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 18:05:08,536 INFO [RS:0;jenkins-hbase9:38785] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 18:05:08,536 INFO [RS:2;jenkins-hbase9:36619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 18:05:08,536 INFO [RS:0;jenkins-hbase9:38785] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,536 INFO [RS:1;jenkins-hbase9:33801] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,537 INFO [RS:2;jenkins-hbase9:36619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,537 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 18:05:08,538 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 18:05:08,537 INFO [RS:0;jenkins-hbase9:38785] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 18:05:08,547 INFO [RS:1;jenkins-hbase9:33801] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,547 INFO [RS:0;jenkins-hbase9:38785] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,547 INFO [RS:2;jenkins-hbase9:36619] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,547 DEBUG [RS:1;jenkins-hbase9:33801] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,547 DEBUG [RS:0;jenkins-hbase9:38785] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,548 DEBUG [RS:1;jenkins-hbase9:33801] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,548 DEBUG [RS:0;jenkins-hbase9:38785] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,548 DEBUG [RS:1;jenkins-hbase9:33801] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,548 DEBUG [RS:0;jenkins-hbase9:38785] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,548 DEBUG [RS:1;jenkins-hbase9:33801] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,549 DEBUG [RS:0;jenkins-hbase9:38785] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,549 DEBUG [RS:1;jenkins-hbase9:33801] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,548 DEBUG [RS:2;jenkins-hbase9:36619] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,549 DEBUG [RS:1;jenkins-hbase9:33801] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 18:05:08,549 DEBUG [RS:2;jenkins-hbase9:36619] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,549 DEBUG [RS:1;jenkins-hbase9:33801] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,549 DEBUG [RS:2;jenkins-hbase9:36619] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,549 DEBUG [RS:1;jenkins-hbase9:33801] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,549 DEBUG [RS:2;jenkins-hbase9:36619] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,549 DEBUG [RS:1;jenkins-hbase9:33801] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,549 DEBUG [RS:2;jenkins-hbase9:36619] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,549 DEBUG [RS:0;jenkins-hbase9:38785] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,550 DEBUG [RS:2;jenkins-hbase9:36619] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 18:05:08,550 DEBUG [RS:1;jenkins-hbase9:33801] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,550 DEBUG [RS:2;jenkins-hbase9:36619] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,550 DEBUG [RS:0;jenkins-hbase9:38785] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 18:05:08,550 DEBUG [RS:2;jenkins-hbase9:36619] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,550 DEBUG [RS:0;jenkins-hbase9:38785] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,550 DEBUG [RS:2;jenkins-hbase9:36619] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,550 DEBUG [RS:0;jenkins-hbase9:38785] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,550 DEBUG [RS:2;jenkins-hbase9:36619] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,550 DEBUG [RS:0;jenkins-hbase9:38785] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,551 DEBUG [RS:0;jenkins-hbase9:38785] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:05:08,555 INFO [RS:0;jenkins-hbase9:38785] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,555 INFO [RS:0;jenkins-hbase9:38785] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,555 INFO [RS:0;jenkins-hbase9:38785] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,561 INFO [RS:1;jenkins-hbase9:33801] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,562 INFO [RS:1;jenkins-hbase9:33801] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,562 INFO [RS:1;jenkins-hbase9:33801] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,562 INFO [RS:2;jenkins-hbase9:36619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,562 INFO [RS:2;jenkins-hbase9:36619] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,562 INFO [RS:2;jenkins-hbase9:36619] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,580 INFO [RS:2;jenkins-hbase9:36619] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 18:05:08,580 INFO [RS:1;jenkins-hbase9:33801] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 18:05:08,580 INFO [RS:0;jenkins-hbase9:38785] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 18:05:08,583 INFO [RS:1;jenkins-hbase9:33801] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33801,1689098707010-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,583 INFO [RS:0;jenkins-hbase9:38785] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38785,1689098706958-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,583 INFO [RS:2;jenkins-hbase9:36619] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36619,1689098707062-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:08,609 INFO [RS:1;jenkins-hbase9:33801] regionserver.Replication(203): jenkins-hbase9.apache.org,33801,1689098707010 started 2023-07-11 18:05:08,609 INFO [RS:0;jenkins-hbase9:38785] regionserver.Replication(203): jenkins-hbase9.apache.org,38785,1689098706958 started 2023-07-11 18:05:08,609 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,33801,1689098707010, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:33801, sessionid=0x10155819b8c0002 2023-07-11 18:05:08,609 INFO [RS:0;jenkins-hbase9:38785] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,38785,1689098706958, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:38785, sessionid=0x10155819b8c0001 2023-07-11 18:05:08,610 INFO [RS:2;jenkins-hbase9:36619] regionserver.Replication(203): jenkins-hbase9.apache.org,36619,1689098707062 started 2023-07-11 18:05:08,610 DEBUG [RS:0;jenkins-hbase9:38785] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 18:05:08,610 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,36619,1689098707062, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:36619, sessionid=0x10155819b8c0003 2023-07-11 18:05:08,610 DEBUG [RS:0;jenkins-hbase9:38785] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:08,610 DEBUG [RS:2;jenkins-hbase9:36619] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 18:05:08,610 DEBUG [RS:0;jenkins-hbase9:38785] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38785,1689098706958' 2023-07-11 18:05:08,610 DEBUG [RS:1;jenkins-hbase9:33801] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 18:05:08,611 DEBUG [RS:0;jenkins-hbase9:38785] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:05:08,610 DEBUG [RS:2;jenkins-hbase9:36619] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:08,611 DEBUG [RS:1;jenkins-hbase9:33801] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:08,612 DEBUG [RS:1;jenkins-hbase9:33801] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33801,1689098707010' 2023-07-11 18:05:08,611 DEBUG [RS:2;jenkins-hbase9:36619] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,36619,1689098707062' 2023-07-11 18:05:08,612 DEBUG [RS:2;jenkins-hbase9:36619] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:05:08,612 DEBUG [RS:1;jenkins-hbase9:33801] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:05:08,612 DEBUG [RS:0;jenkins-hbase9:38785] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:05:08,612 DEBUG [RS:2;jenkins-hbase9:36619] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:05:08,612 DEBUG [RS:1;jenkins-hbase9:33801] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:05:08,613 DEBUG [RS:0;jenkins-hbase9:38785] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 18:05:08,613 DEBUG [RS:0;jenkins-hbase9:38785] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 18:05:08,613 DEBUG [RS:0;jenkins-hbase9:38785] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:08,613 DEBUG [RS:0;jenkins-hbase9:38785] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38785,1689098706958' 2023-07-11 18:05:08,613 DEBUG [RS:0;jenkins-hbase9:38785] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 18:05:08,613 DEBUG [RS:1;jenkins-hbase9:33801] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 18:05:08,613 DEBUG [RS:2;jenkins-hbase9:36619] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 18:05:08,613 DEBUG [RS:1;jenkins-hbase9:33801] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 18:05:08,613 DEBUG [RS:2;jenkins-hbase9:36619] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 18:05:08,613 DEBUG [RS:1;jenkins-hbase9:33801] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:08,614 DEBUG [RS:0;jenkins-hbase9:38785] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 18:05:08,613 DEBUG [RS:2;jenkins-hbase9:36619] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:08,614 DEBUG [RS:2;jenkins-hbase9:36619] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,36619,1689098707062' 2023-07-11 18:05:08,614 DEBUG [RS:1;jenkins-hbase9:33801] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33801,1689098707010' 2023-07-11 18:05:08,614 DEBUG [RS:1;jenkins-hbase9:33801] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 18:05:08,614 DEBUG [RS:2;jenkins-hbase9:36619] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 18:05:08,615 DEBUG [RS:1;jenkins-hbase9:33801] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 18:05:08,615 DEBUG [RS:2;jenkins-hbase9:36619] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 18:05:08,616 DEBUG [RS:1;jenkins-hbase9:33801] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 18:05:08,616 DEBUG [RS:2;jenkins-hbase9:36619] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 18:05:08,616 INFO [RS:1;jenkins-hbase9:33801] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 18:05:08,617 DEBUG [RS:0;jenkins-hbase9:38785] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 18:05:08,616 INFO [RS:2;jenkins-hbase9:36619] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 18:05:08,618 INFO [RS:2;jenkins-hbase9:36619] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 18:05:08,618 INFO [RS:0;jenkins-hbase9:38785] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 18:05:08,617 INFO [RS:1;jenkins-hbase9:33801] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 18:05:08,618 INFO [RS:0;jenkins-hbase9:38785] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 18:05:08,629 DEBUG [jenkins-hbase9:35481] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-11 18:05:08,633 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:05:08,639 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:05:08,639 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:05:08,639 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:05:08,639 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:05:08,642 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,38785,1689098706958, state=OPENING 2023-07-11 18:05:08,649 DEBUG [PEWorker-1] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 18:05:08,652 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:05:08,653 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 18:05:08,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,38785,1689098706958}] 2023-07-11 18:05:08,732 INFO [RS:1;jenkins-hbase9:33801] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33801%2C1689098707010, suffix=, logDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,33801,1689098707010, archiveDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/oldWALs, maxLogs=32 2023-07-11 18:05:08,732 INFO [RS:2;jenkins-hbase9:36619] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C36619%2C1689098707062, suffix=, logDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,36619,1689098707062, archiveDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/oldWALs, maxLogs=32 2023-07-11 18:05:08,732 INFO [RS:0;jenkins-hbase9:38785] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38785%2C1689098706958, suffix=, logDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958, archiveDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/oldWALs, maxLogs=32 2023-07-11 18:05:08,760 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK] 2023-07-11 18:05:08,765 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK] 2023-07-11 18:05:08,767 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK] 2023-07-11 18:05:08,769 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK] 2023-07-11 18:05:08,769 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK] 2023-07-11 18:05:08,769 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK] 2023-07-11 18:05:08,783 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK] 2023-07-11 18:05:08,783 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK] 2023-07-11 18:05:08,783 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK] 2023-07-11 18:05:08,793 INFO [RS:1;jenkins-hbase9:33801] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,33801,1689098707010/jenkins-hbase9.apache.org%2C33801%2C1689098707010.1689098708737 2023-07-11 18:05:08,794 DEBUG [RS:1;jenkins-hbase9:33801] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK], DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK], DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK]] 2023-07-11 18:05:08,794 INFO [RS:0;jenkins-hbase9:38785] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736 2023-07-11 18:05:08,796 INFO [RS:2;jenkins-hbase9:36619] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,36619,1689098707062/jenkins-hbase9.apache.org%2C36619%2C1689098707062.1689098708737 2023-07-11 18:05:08,797 DEBUG [RS:0;jenkins-hbase9:38785] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK], DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK], DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK]] 2023-07-11 18:05:08,797 DEBUG [RS:2;jenkins-hbase9:36619] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK], DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK], DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK]] 2023-07-11 18:05:08,849 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:08,852 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:05:08,856 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 18:05:08,874 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 18:05:08,875 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:05:08,880 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta, suffix=.meta, logDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958, archiveDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/oldWALs, maxLogs=32 2023-07-11 18:05:08,908 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK] 2023-07-11 18:05:08,910 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK] 2023-07-11 18:05:08,915 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK] 2023-07-11 18:05:08,925 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta 2023-07-11 18:05:08,926 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK], DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK], DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK]] 2023-07-11 18:05:08,927 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:05:08,928 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 18:05:08,945 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 18:05:08,951 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 18:05:08,956 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 18:05:08,956 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:08,957 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 18:05:08,957 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 18:05:08,960 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 18:05:08,962 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/info 2023-07-11 18:05:08,962 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/info 2023-07-11 18:05:08,962 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 18:05:08,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:08,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 18:05:08,965 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/rep_barrier 2023-07-11 18:05:08,965 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/rep_barrier 2023-07-11 18:05:08,966 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 18:05:08,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:08,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 18:05:08,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/table 2023-07-11 18:05:08,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/table 2023-07-11 18:05:08,970 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 18:05:08,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:08,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740 2023-07-11 18:05:08,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740 2023-07-11 18:05:08,980 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:08,983 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 18:05:08,985 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66350040, jitterRate=-0.011307358741760254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:08,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 18:05:09,001 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689098708837 2023-07-11 18:05:09,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 18:05:09,028 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 18:05:09,029 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,38785,1689098706958, state=OPEN 2023-07-11 18:05:09,032 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 18:05:09,032 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 18:05:09,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 18:05:09,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,38785,1689098706958 in 376 msec 2023-07-11 18:05:09,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 18:05:09,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 595 msec 2023-07-11 18:05:09,048 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 886 msec 2023-07-11 18:05:09,049 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689098709049, completionTime=-1 2023-07-11 18:05:09,049 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-11 18:05:09,049 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:05:09,137 DEBUG [hconnection-0x2b5ea280-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:05:09,140 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:05:09,159 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-11 18:05:09,159 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689098769159 2023-07-11 18:05:09,159 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689098829159 2023-07-11 18:05:09,159 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 109 msec 2023-07-11 18:05:09,185 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35481,1689098705729-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:09,186 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35481,1689098705729-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:09,186 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35481,1689098705729-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:09,187 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:35481, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:09,188 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 18:05:09,198 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 18:05:09,208 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 18:05:09,210 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 18:05:09,220 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 18:05:09,222 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:05:09,226 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:05:09,251 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/hbase/namespace/ca21663676d98522661b9a7b1a038300 2023-07-11 18:05:09,254 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/hbase/namespace/ca21663676d98522661b9a7b1a038300 empty. 2023-07-11 18:05:09,255 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/hbase/namespace/ca21663676d98522661b9a7b1a038300 2023-07-11 18:05:09,255 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 18:05:09,305 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 18:05:09,307 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ca21663676d98522661b9a7b1a038300, NAME => 'hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:09,327 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:09,327 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ca21663676d98522661b9a7b1a038300, disabling compactions & flushes 2023-07-11 18:05:09,327 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:05:09,327 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:05:09,327 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. after waiting 0 ms 2023-07-11 18:05:09,327 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:05:09,327 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:05:09,327 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ca21663676d98522661b9a7b1a038300: 2023-07-11 18:05:09,335 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:05:09,349 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689098709337"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098709337"}]},"ts":"1689098709337"} 2023-07-11 18:05:09,376 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:05:09,378 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:05:09,383 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098709379"}]},"ts":"1689098709379"} 2023-07-11 18:05:09,388 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 18:05:09,392 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:05:09,394 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:05:09,394 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:05:09,394 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:05:09,394 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:05:09,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ca21663676d98522661b9a7b1a038300, ASSIGN}] 2023-07-11 18:05:09,400 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ca21663676d98522661b9a7b1a038300, ASSIGN 2023-07-11 18:05:09,402 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ca21663676d98522661b9a7b1a038300, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38785,1689098706958; forceNewPlan=false, retain=false 2023-07-11 18:05:09,555 INFO [jenkins-hbase9:35481] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:05:09,556 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ca21663676d98522661b9a7b1a038300, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:09,556 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689098709556"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098709556"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098709556"}]},"ts":"1689098709556"} 2023-07-11 18:05:09,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ca21663676d98522661b9a7b1a038300, server=jenkins-hbase9.apache.org,38785,1689098706958}] 2023-07-11 18:05:09,734 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:05:09,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca21663676d98522661b9a7b1a038300, NAME => 'hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:05:09,735 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ca21663676d98522661b9a7b1a038300 2023-07-11 18:05:09,735 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:09,735 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ca21663676d98522661b9a7b1a038300 2023-07-11 18:05:09,735 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ca21663676d98522661b9a7b1a038300 2023-07-11 18:05:09,740 INFO [StoreOpener-ca21663676d98522661b9a7b1a038300-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ca21663676d98522661b9a7b1a038300 2023-07-11 18:05:09,743 DEBUG [StoreOpener-ca21663676d98522661b9a7b1a038300-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/info 2023-07-11 18:05:09,743 DEBUG [StoreOpener-ca21663676d98522661b9a7b1a038300-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/info 2023-07-11 18:05:09,744 INFO [StoreOpener-ca21663676d98522661b9a7b1a038300-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca21663676d98522661b9a7b1a038300 columnFamilyName info 2023-07-11 18:05:09,745 INFO [StoreOpener-ca21663676d98522661b9a7b1a038300-1] regionserver.HStore(310): Store=ca21663676d98522661b9a7b1a038300/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:09,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300 2023-07-11 18:05:09,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300 2023-07-11 18:05:09,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ca21663676d98522661b9a7b1a038300 2023-07-11 18:05:09,756 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:09,757 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ca21663676d98522661b9a7b1a038300; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63738518, jitterRate=-0.05022206902503967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:05:09,757 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ca21663676d98522661b9a7b1a038300: 2023-07-11 18:05:09,759 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300., pid=6, masterSystemTime=1689098709721 2023-07-11 18:05:09,763 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:05:09,763 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:05:09,765 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ca21663676d98522661b9a7b1a038300, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:09,765 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689098709764"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098709764"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098709764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098709764"}]},"ts":"1689098709764"} 2023-07-11 18:05:09,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 18:05:09,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ca21663676d98522661b9a7b1a038300, server=jenkins-hbase9.apache.org,38785,1689098706958 in 206 msec 2023-07-11 18:05:09,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 18:05:09,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ca21663676d98522661b9a7b1a038300, ASSIGN in 378 msec 2023-07-11 18:05:09,780 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:05:09,781 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098709780"}]},"ts":"1689098709780"} 2023-07-11 18:05:09,783 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 18:05:09,786 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:05:09,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 575 msec 2023-07-11 18:05:09,825 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 18:05:09,828 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 18:05:09,828 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:05:09,863 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 18:05:09,883 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 18:05:09,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-07-11 18:05:09,897 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:05:09,911 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 18:05:09,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-11 18:05:09,924 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 18:05:09,927 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 18:05:09,927 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.791sec 2023-07-11 18:05:09,931 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 18:05:09,932 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 18:05:09,932 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 18:05:09,933 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35481,1689098705729-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 18:05:09,934 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35481,1689098705729-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 18:05:09,962 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 18:05:10,006 DEBUG [Listener at localhost/46025] zookeeper.ReadOnlyZKClient(139): Connect 0x16ae3423 to 127.0.0.1:56404 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:05:10,029 DEBUG [Listener at localhost/46025] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34c74e78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:05:10,047 DEBUG [hconnection-0x2e8c0f62-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:05:10,063 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:05:10,077 INFO [Listener at localhost/46025] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,35481,1689098705729 2023-07-11 18:05:10,079 WARN [Listener at localhost/46025] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-11 18:05:10,092 DEBUG [Listener at localhost/46025] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 18:05:10,097 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 18:05:10,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:05:10,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 18:05:10,123 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:05:10,127 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:05:10,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true" procId is: 9 2023-07-11 18:05:10,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 18:05:10,164 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707 2023-07-11 18:05:10,164 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a 2023-07-11 18:05:10,164 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:05:10,165 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c 2023-07-11 18:05:10,165 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:05:10,166 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707 empty. 2023-07-11 18:05:10,166 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f 2023-07-11 18:05:10,166 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:05:10,166 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:05:10,166 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a empty. 2023-07-11 18:05:10,167 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c empty. 2023-07-11 18:05:10,169 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210 empty. 2023-07-11 18:05:10,170 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a 2023-07-11 18:05:10,170 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:05:10,170 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c 2023-07-11 18:05:10,170 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:05:10,171 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803 empty. 2023-07-11 18:05:10,171 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723 empty. 2023-07-11 18:05:10,172 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:05:10,172 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:05:10,172 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:05:10,172 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42 2023-07-11 18:05:10,175 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85 empty. 2023-07-11 18:05:10,175 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613 empty. 2023-07-11 18:05:10,176 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475 empty. 2023-07-11 18:05:10,176 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f empty. 2023-07-11 18:05:10,176 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:05:10,176 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:05:10,176 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c empty. 2023-07-11 18:05:10,176 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:05:10,176 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:05:10,177 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:05:10,177 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:05:10,177 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:05:10,178 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651 2023-07-11 18:05:10,178 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f 2023-07-11 18:05:10,178 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41 empty. 2023-07-11 18:05:10,178 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba empty. 2023-07-11 18:05:10,178 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:05:10,179 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a empty. 2023-07-11 18:05:10,179 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707 2023-07-11 18:05:10,179 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:05:10,179 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42 empty. 2023-07-11 18:05:10,179 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651 empty. 2023-07-11 18:05:10,179 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:05:10,180 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:05:10,181 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:05:10,181 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414 2023-07-11 18:05:10,181 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651 2023-07-11 18:05:10,181 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:05:10,181 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:05:10,181 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42 2023-07-11 18:05:10,181 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:05:10,181 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c 2023-07-11 18:05:10,182 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e empty. 2023-07-11 18:05:10,182 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae empty. 2023-07-11 18:05:10,182 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:05:10,182 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7 2023-07-11 18:05:10,183 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86 empty. 2023-07-11 18:05:10,183 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1 empty. 2023-07-11 18:05:10,183 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414 empty. 2023-07-11 18:05:10,183 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c empty. 2023-07-11 18:05:10,183 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:05:10,183 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45 empty. 2023-07-11 18:05:10,183 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:05:10,183 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:05:10,184 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:05:10,184 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7 empty. 2023-07-11 18:05:10,184 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:05:10,184 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:05:10,187 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414 2023-07-11 18:05:10,187 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c 2023-07-11 18:05:10,188 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:05:10,188 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7 2023-07-11 18:05:10,192 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee empty. 2023-07-11 18:05:10,192 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e empty. 2023-07-11 18:05:10,192 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:05:10,192 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:05:10,192 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true regions 2023-07-11 18:05:10,224 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/.tabledesc/.tableinfo.0000000001 2023-07-11 18:05:10,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 18:05:10,272 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => e6114557edd3e2be4679297c99dbb707, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707.', STARTKEY => '', ENDKEY => 'bbb'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,273 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 68a671ac00030280ed3c9b59840a157c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c.', STARTKEY => 'ccc', ENDKEY => 'ddd'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,273 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => cfeeac3165a77206892059eaf409a93a, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a.', STARTKEY => 'bbb', ENDKEY => 'ccc'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,350 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,351 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 68a671ac00030280ed3c9b59840a157c, disabling compactions & flushes 2023-07-11 18:05:10,351 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:05:10,351 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:05:10,351 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. after waiting 0 ms 2023-07-11 18:05:10,351 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,352 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing e6114557edd3e2be4679297c99dbb707, disabling compactions & flushes 2023-07-11 18:05:10,352 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,351 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:05:10,352 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing cfeeac3165a77206892059eaf409a93a, disabling compactions & flushes 2023-07-11 18:05:10,352 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:05:10,352 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:05:10,352 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 68a671ac00030280ed3c9b59840a157c: 2023-07-11 18:05:10,352 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:05:10,353 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:05:10,353 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:05:10,353 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. after waiting 0 ms 2023-07-11 18:05:10,353 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. after waiting 0 ms 2023-07-11 18:05:10,353 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:05:10,353 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:05:10,353 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:05:10,353 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 66c52954a1e65ac4eea3ad65ab781210, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210.', STARTKEY => 'ddd', ENDKEY => 'eee'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,353 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for cfeeac3165a77206892059eaf409a93a: 2023-07-11 18:05:10,353 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:05:10,354 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for e6114557edd3e2be4679297c99dbb707: 2023-07-11 18:05:10,355 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 34ae1cb300031e6413911b11bb3c0613, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613.', STARTKEY => 'eee', ENDKEY => 'fff'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,355 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => a535c854541161846ee0519898cadf3f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f.', STARTKEY => 'fff', ENDKEY => 'ggg'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,377 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,377 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 66c52954a1e65ac4eea3ad65ab781210, disabling compactions & flushes 2023-07-11 18:05:10,377 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:05:10,377 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:05:10,377 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. after waiting 0 ms 2023-07-11 18:05:10,377 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:05:10,377 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:05:10,378 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 66c52954a1e65ac4eea3ad65ab781210: 2023-07-11 18:05:10,378 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 1e821bd6d21478c1aef93851d0f84803, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803.', STARTKEY => 'ggg', ENDKEY => 'hhh'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,398 WARN [DataStreamer for file /user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/.regioninfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-11 18:05:10,400 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,401 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing a535c854541161846ee0519898cadf3f, disabling compactions & flushes 2023-07-11 18:05:10,401 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:05:10,401 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:05:10,401 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. after waiting 0 ms 2023-07-11 18:05:10,401 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:05:10,401 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:05:10,401 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,401 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for a535c854541161846ee0519898cadf3f: 2023-07-11 18:05:10,401 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 34ae1cb300031e6413911b11bb3c0613, disabling compactions & flushes 2023-07-11 18:05:10,402 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6fd79949daf97fb71187ed6ccb826c85, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85.', STARTKEY => 'hhh', ENDKEY => 'iii'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,402 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:05:10,402 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:05:10,402 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. after waiting 0 ms 2023-07-11 18:05:10,402 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:05:10,402 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:05:10,402 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 34ae1cb300031e6413911b11bb3c0613: 2023-07-11 18:05:10,403 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => ca97340b0ab43753a8263ae334c5b475, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475.', STARTKEY => 'iii', ENDKEY => 'jjj'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,452 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,455 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 1e821bd6d21478c1aef93851d0f84803, disabling compactions & flushes 2023-07-11 18:05:10,455 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:05:10,455 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:05:10,455 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. after waiting 0 ms 2023-07-11 18:05:10,455 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:05:10,455 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:05:10,455 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 1e821bd6d21478c1aef93851d0f84803: 2023-07-11 18:05:10,456 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 9d068f7fd612d2e21c191a1d38a29723, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723.', STARTKEY => 'jjj', ENDKEY => 'kkk'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,469 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,470 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing ca97340b0ab43753a8263ae334c5b475, disabling compactions & flushes 2023-07-11 18:05:10,470 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:05:10,470 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:05:10,470 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. after waiting 0 ms 2023-07-11 18:05:10,470 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:05:10,470 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:05:10,470 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for ca97340b0ab43753a8263ae334c5b475: 2023-07-11 18:05:10,471 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => c41300b446f1c31843a2ac322189ac5c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c.', STARTKEY => 'kkk', ENDKEY => 'lll'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 18:05:10,490 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,491 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 6fd79949daf97fb71187ed6ccb826c85, disabling compactions & flushes 2023-07-11 18:05:10,491 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:05:10,491 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:05:10,491 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. after waiting 0 ms 2023-07-11 18:05:10,491 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:05:10,491 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:05:10,491 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 6fd79949daf97fb71187ed6ccb826c85: 2023-07-11 18:05:10,492 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 01c403825db7c339c13e2f1101543b42, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42.', STARTKEY => 'lll', ENDKEY => 'mmm'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,521 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,521 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 9d068f7fd612d2e21c191a1d38a29723, disabling compactions & flushes 2023-07-11 18:05:10,521 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:05:10,522 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:05:10,522 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. after waiting 0 ms 2023-07-11 18:05:10,522 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:05:10,522 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:05:10,522 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 9d068f7fd612d2e21c191a1d38a29723: 2023-07-11 18:05:10,523 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => c07a104cc172022c4212e2e7a10199ba, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba.', STARTKEY => 'mmm', ENDKEY => 'nnn'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,548 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,549 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 01c403825db7c339c13e2f1101543b42, disabling compactions & flushes 2023-07-11 18:05:10,549 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:05:10,549 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,549 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:05:10,550 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing c41300b446f1c31843a2ac322189ac5c, disabling compactions & flushes 2023-07-11 18:05:10,550 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. after waiting 0 ms 2023-07-11 18:05:10,550 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:05:10,550 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:05:10,550 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:05:10,550 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 01c403825db7c339c13e2f1101543b42: 2023-07-11 18:05:10,551 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1851532129addae5c0e78c4af9fe4b41, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41.', STARTKEY => 'nnn', ENDKEY => 'ooo'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,550 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:05:10,552 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. after waiting 0 ms 2023-07-11 18:05:10,552 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:05:10,552 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:05:10,552 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for c41300b446f1c31843a2ac322189ac5c: 2023-07-11 18:05:10,552 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9e32425e5b5ae93a85c8ed8a3e29ad2a, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a.', STARTKEY => 'ooo', ENDKEY => 'ppp'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,603 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,605 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing c07a104cc172022c4212e2e7a10199ba, disabling compactions & flushes 2023-07-11 18:05:10,605 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:05:10,606 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:05:10,606 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. after waiting 0 ms 2023-07-11 18:05:10,606 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:05:10,606 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:05:10,606 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for c07a104cc172022c4212e2e7a10199ba: 2023-07-11 18:05:10,606 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 697385c0414f8f3b285f33f1ce166651, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651.', STARTKEY => 'ppp', ENDKEY => 'qqq'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,616 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,617 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 1851532129addae5c0e78c4af9fe4b41, disabling compactions & flushes 2023-07-11 18:05:10,617 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:05:10,617 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:05:10,617 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. after waiting 0 ms 2023-07-11 18:05:10,617 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:05:10,617 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:05:10,617 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 1851532129addae5c0e78c4af9fe4b41: 2023-07-11 18:05:10,618 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3a49a7d0f0c324e9e04b887b069379ae, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae.', STARTKEY => 'qqq', ENDKEY => 'rrr'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,630 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,630 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 9e32425e5b5ae93a85c8ed8a3e29ad2a, disabling compactions & flushes 2023-07-11 18:05:10,631 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:05:10,631 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:05:10,631 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. after waiting 0 ms 2023-07-11 18:05:10,631 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:05:10,631 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:05:10,631 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 9e32425e5b5ae93a85c8ed8a3e29ad2a: 2023-07-11 18:05:10,631 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 12ffd9ba99aec19d05a9a4bdc190df5e, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e.', STARTKEY => 'rrr', ENDKEY => 'sss'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,644 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,645 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 697385c0414f8f3b285f33f1ce166651, disabling compactions & flushes 2023-07-11 18:05:10,645 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:05:10,645 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:05:10,645 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. after waiting 0 ms 2023-07-11 18:05:10,646 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:05:10,646 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:05:10,646 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 697385c0414f8f3b285f33f1ce166651: 2023-07-11 18:05:10,646 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 3fda35ffdbf54a7596d1f6e9dd4c3a45, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45.', STARTKEY => 'sss', ENDKEY => 'ttt'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,659 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,660 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 3a49a7d0f0c324e9e04b887b069379ae, disabling compactions & flushes 2023-07-11 18:05:10,660 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:05:10,660 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:05:10,660 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. after waiting 0 ms 2023-07-11 18:05:10,660 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:05:10,661 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:05:10,661 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 3a49a7d0f0c324e9e04b887b069379ae: 2023-07-11 18:05:10,661 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => cc5337c98b33958209dee082b9968414, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414.', STARTKEY => 'ttt', ENDKEY => 'uuu'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,680 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,681 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 12ffd9ba99aec19d05a9a4bdc190df5e, disabling compactions & flushes 2023-07-11 18:05:10,681 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:05:10,681 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:05:10,681 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. after waiting 0 ms 2023-07-11 18:05:10,681 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:05:10,681 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:05:10,681 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 12ffd9ba99aec19d05a9a4bdc190df5e: 2023-07-11 18:05:10,682 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8360d53793b402665c7d088b5757078c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c.', STARTKEY => 'uuu', ENDKEY => 'vvv'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,699 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,699 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 3fda35ffdbf54a7596d1f6e9dd4c3a45, disabling compactions & flushes 2023-07-11 18:05:10,700 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:05:10,700 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:05:10,700 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. after waiting 0 ms 2023-07-11 18:05:10,700 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:05:10,700 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:05:10,700 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 3fda35ffdbf54a7596d1f6e9dd4c3a45: 2023-07-11 18:05:10,700 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 66f3e358060a5746d9b9f7c8e30affd1, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1.', STARTKEY => 'vvv', ENDKEY => 'www'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,737 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,742 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing cc5337c98b33958209dee082b9968414, disabling compactions & flushes 2023-07-11 18:05:10,742 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:05:10,742 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:05:10,742 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. after waiting 0 ms 2023-07-11 18:05:10,742 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:05:10,742 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:05:10,742 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for cc5337c98b33958209dee082b9968414: 2023-07-11 18:05:10,743 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 082ae0e1538d0ea4afa6018633714d86, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86.', STARTKEY => 'www', ENDKEY => 'xxx'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,743 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,744 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 8360d53793b402665c7d088b5757078c, disabling compactions & flushes 2023-07-11 18:05:10,744 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:05:10,744 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:05:10,744 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. after waiting 0 ms 2023-07-11 18:05:10,744 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:05:10,744 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:05:10,744 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 8360d53793b402665c7d088b5757078c: 2023-07-11 18:05:10,744 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => f4618a109b5b547019676f2a63009dd7, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7.', STARTKEY => 'xxx', ENDKEY => 'yyy'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,752 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,754 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 66f3e358060a5746d9b9f7c8e30affd1, disabling compactions & flushes 2023-07-11 18:05:10,754 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:05:10,754 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:05:10,754 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. after waiting 0 ms 2023-07-11 18:05:10,754 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:05:10,754 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:05:10,754 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 66f3e358060a5746d9b9f7c8e30affd1: 2023-07-11 18:05:10,755 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 9dd9757b1ce8f958386c6599a273f3ee, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee.', STARTKEY => 'yyy', ENDKEY => 'zzz'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 18:05:10,788 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,789 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing f4618a109b5b547019676f2a63009dd7, disabling compactions & flushes 2023-07-11 18:05:10,789 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:05:10,789 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:05:10,789 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. after waiting 0 ms 2023-07-11 18:05:10,789 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:05:10,790 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:05:10,790 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for f4618a109b5b547019676f2a63009dd7: 2023-07-11 18:05:10,790 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => f32630ccb5e2306ee100dad5b0bd664e, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e.', STARTKEY => 'zzz', ENDKEY => ''}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/.tmp 2023-07-11 18:05:10,792 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,792 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 082ae0e1538d0ea4afa6018633714d86, disabling compactions & flushes 2023-07-11 18:05:10,792 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:05:10,792 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:05:10,793 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. after waiting 0 ms 2023-07-11 18:05:10,793 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:05:10,793 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:05:10,793 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 082ae0e1538d0ea4afa6018633714d86: 2023-07-11 18:05:10,839 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,842 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 9dd9757b1ce8f958386c6599a273f3ee, disabling compactions & flushes 2023-07-11 18:05:10,842 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:05:10,842 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:05:10,842 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. after waiting 0 ms 2023-07-11 18:05:10,842 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:05:10,842 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:05:10,842 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 9dd9757b1ce8f958386c6599a273f3ee: 2023-07-11 18:05:10,848 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:10,849 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing f32630ccb5e2306ee100dad5b0bd664e, disabling compactions & flushes 2023-07-11 18:05:10,849 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:05:10,849 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:05:10,849 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. after waiting 0 ms 2023-07-11 18:05:10,849 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:05:10,849 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:05:10,849 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for f32630ccb5e2306ee100dad5b0bd664e: 2023-07-11 18:05:10,862 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:05:10,865 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,865 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,865 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,866 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,866 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,866 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,866 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,866 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,867 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,867 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,867 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,867 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,867 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,867 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,868 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,868 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,868 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,868 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,868 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,868 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,868 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,868 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,869 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,869 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,869 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,869 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689098710864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098710864"}]},"ts":"1689098710864"} 2023-07-11 18:05:10,925 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 26 regions to meta. 2023-07-11 18:05:10,928 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:05:10,928 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098710928"}]},"ts":"1689098710928"} 2023-07-11 18:05:10,931 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLING in hbase:meta 2023-07-11 18:05:10,935 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:05:10,977 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:05:10,977 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:05:10,977 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:05:10,977 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:05:10,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6114557edd3e2be4679297c99dbb707, ASSIGN}, {pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cfeeac3165a77206892059eaf409a93a, ASSIGN}, {pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=68a671ac00030280ed3c9b59840a157c, ASSIGN}, {pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66c52954a1e65ac4eea3ad65ab781210, ASSIGN}, {pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34ae1cb300031e6413911b11bb3c0613, ASSIGN}, {pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a535c854541161846ee0519898cadf3f, ASSIGN}, {pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1e821bd6d21478c1aef93851d0f84803, ASSIGN}, {pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fd79949daf97fb71187ed6ccb826c85, ASSIGN}, {pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ca97340b0ab43753a8263ae334c5b475, ASSIGN}, {pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d068f7fd612d2e21c191a1d38a29723, ASSIGN}, {pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c41300b446f1c31843a2ac322189ac5c, ASSIGN}, {pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=01c403825db7c339c13e2f1101543b42, ASSIGN}, {pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c07a104cc172022c4212e2e7a10199ba, ASSIGN}, {pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1851532129addae5c0e78c4af9fe4b41, ASSIGN}, {pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e32425e5b5ae93a85c8ed8a3e29ad2a, ASSIGN}, {pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=697385c0414f8f3b285f33f1ce166651, ASSIGN}, {pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3a49a7d0f0c324e9e04b887b069379ae, ASSIGN}, {pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=12ffd9ba99aec19d05a9a4bdc190df5e, ASSIGN}, {pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3fda35ffdbf54a7596d1f6e9dd4c3a45, ASSIGN}, {pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cc5337c98b33958209dee082b9968414, ASSIGN}, {pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8360d53793b402665c7d088b5757078c, ASSIGN}, {pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66f3e358060a5746d9b9f7c8e30affd1, ASSIGN}, {pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=082ae0e1538d0ea4afa6018633714d86, ASSIGN}, {pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f4618a109b5b547019676f2a63009dd7, ASSIGN}, {pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9dd9757b1ce8f958386c6599a273f3ee, ASSIGN}, {pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f32630ccb5e2306ee100dad5b0bd664e, ASSIGN}] 2023-07-11 18:05:10,990 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f32630ccb5e2306ee100dad5b0bd664e, ASSIGN 2023-07-11 18:05:10,992 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f32630ccb5e2306ee100dad5b0bd664e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36619,1689098707062; forceNewPlan=false, retain=false 2023-07-11 18:05:10,993 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9dd9757b1ce8f958386c6599a273f3ee, ASSIGN 2023-07-11 18:05:10,995 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9dd9757b1ce8f958386c6599a273f3ee, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33801,1689098707010; forceNewPlan=false, retain=false 2023-07-11 18:05:10,996 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f4618a109b5b547019676f2a63009dd7, ASSIGN 2023-07-11 18:05:10,997 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f4618a109b5b547019676f2a63009dd7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36619,1689098707062; forceNewPlan=false, retain=false 2023-07-11 18:05:10,998 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=082ae0e1538d0ea4afa6018633714d86, ASSIGN 2023-07-11 18:05:10,999 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=082ae0e1538d0ea4afa6018633714d86, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38785,1689098706958; forceNewPlan=false, retain=false 2023-07-11 18:05:11,000 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66f3e358060a5746d9b9f7c8e30affd1, ASSIGN 2023-07-11 18:05:11,004 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66f3e358060a5746d9b9f7c8e30affd1, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33801,1689098707010; forceNewPlan=false, retain=false 2023-07-11 18:05:11,005 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8360d53793b402665c7d088b5757078c, ASSIGN 2023-07-11 18:05:11,009 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8360d53793b402665c7d088b5757078c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38785,1689098706958; forceNewPlan=false, retain=false 2023-07-11 18:05:11,011 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cc5337c98b33958209dee082b9968414, ASSIGN 2023-07-11 18:05:11,012 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cc5337c98b33958209dee082b9968414, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36619,1689098707062; forceNewPlan=false, retain=false 2023-07-11 18:05:11,013 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3fda35ffdbf54a7596d1f6e9dd4c3a45, ASSIGN 2023-07-11 18:05:11,014 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3fda35ffdbf54a7596d1f6e9dd4c3a45, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33801,1689098707010; forceNewPlan=false, retain=false 2023-07-11 18:05:11,015 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=12ffd9ba99aec19d05a9a4bdc190df5e, ASSIGN 2023-07-11 18:05:11,017 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=12ffd9ba99aec19d05a9a4bdc190df5e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38785,1689098706958; forceNewPlan=false, retain=false 2023-07-11 18:05:11,020 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3a49a7d0f0c324e9e04b887b069379ae, ASSIGN 2023-07-11 18:05:11,021 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3a49a7d0f0c324e9e04b887b069379ae, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36619,1689098707062; forceNewPlan=false, retain=false 2023-07-11 18:05:11,022 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=697385c0414f8f3b285f33f1ce166651, ASSIGN 2023-07-11 18:05:11,023 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=697385c0414f8f3b285f33f1ce166651, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33801,1689098707010; forceNewPlan=false, retain=false 2023-07-11 18:05:11,024 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e32425e5b5ae93a85c8ed8a3e29ad2a, ASSIGN 2023-07-11 18:05:11,025 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e32425e5b5ae93a85c8ed8a3e29ad2a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38785,1689098706958; forceNewPlan=false, retain=false 2023-07-11 18:05:11,026 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1851532129addae5c0e78c4af9fe4b41, ASSIGN 2023-07-11 18:05:11,027 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1851532129addae5c0e78c4af9fe4b41, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36619,1689098707062; forceNewPlan=false, retain=false 2023-07-11 18:05:11,028 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c07a104cc172022c4212e2e7a10199ba, ASSIGN 2023-07-11 18:05:11,029 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c07a104cc172022c4212e2e7a10199ba, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33801,1689098707010; forceNewPlan=false, retain=false 2023-07-11 18:05:11,030 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=01c403825db7c339c13e2f1101543b42, ASSIGN 2023-07-11 18:05:11,032 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=01c403825db7c339c13e2f1101543b42, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36619,1689098707062; forceNewPlan=false, retain=false 2023-07-11 18:05:11,033 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c41300b446f1c31843a2ac322189ac5c, ASSIGN 2023-07-11 18:05:11,034 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c41300b446f1c31843a2ac322189ac5c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38785,1689098706958; forceNewPlan=false, retain=false 2023-07-11 18:05:11,035 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d068f7fd612d2e21c191a1d38a29723, ASSIGN 2023-07-11 18:05:11,036 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d068f7fd612d2e21c191a1d38a29723, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33801,1689098707010; forceNewPlan=false, retain=false 2023-07-11 18:05:11,037 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ca97340b0ab43753a8263ae334c5b475, ASSIGN 2023-07-11 18:05:11,040 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ca97340b0ab43753a8263ae334c5b475, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36619,1689098707062; forceNewPlan=false, retain=false 2023-07-11 18:05:11,041 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fd79949daf97fb71187ed6ccb826c85, ASSIGN 2023-07-11 18:05:11,042 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fd79949daf97fb71187ed6ccb826c85, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38785,1689098706958; forceNewPlan=false, retain=false 2023-07-11 18:05:11,043 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1e821bd6d21478c1aef93851d0f84803, ASSIGN 2023-07-11 18:05:11,044 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1e821bd6d21478c1aef93851d0f84803, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33801,1689098707010; forceNewPlan=false, retain=false 2023-07-11 18:05:11,045 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a535c854541161846ee0519898cadf3f, ASSIGN 2023-07-11 18:05:11,047 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a535c854541161846ee0519898cadf3f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36619,1689098707062; forceNewPlan=false, retain=false 2023-07-11 18:05:11,048 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34ae1cb300031e6413911b11bb3c0613, ASSIGN 2023-07-11 18:05:11,049 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34ae1cb300031e6413911b11bb3c0613, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38785,1689098706958; forceNewPlan=false, retain=false 2023-07-11 18:05:11,050 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66c52954a1e65ac4eea3ad65ab781210, ASSIGN 2023-07-11 18:05:11,051 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66c52954a1e65ac4eea3ad65ab781210, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33801,1689098707010; forceNewPlan=false, retain=false 2023-07-11 18:05:11,052 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=68a671ac00030280ed3c9b59840a157c, ASSIGN 2023-07-11 18:05:11,054 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=68a671ac00030280ed3c9b59840a157c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33801,1689098707010; forceNewPlan=false, retain=false 2023-07-11 18:05:11,055 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cfeeac3165a77206892059eaf409a93a, ASSIGN 2023-07-11 18:05:11,056 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cfeeac3165a77206892059eaf409a93a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36619,1689098707062; forceNewPlan=false, retain=false 2023-07-11 18:05:11,057 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6114557edd3e2be4679297c99dbb707, ASSIGN 2023-07-11 18:05:11,058 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6114557edd3e2be4679297c99dbb707, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38785,1689098706958; forceNewPlan=false, retain=false 2023-07-11 18:05:11,143 INFO [jenkins-hbase9:35481] balancer.BaseLoadBalancer(1545): Reassigned 26 regions. 26 retained the pre-restart assignment. 2023-07-11 18:05:11,150 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c41300b446f1c31843a2ac322189ac5c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,151 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711150"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711150"}]},"ts":"1689098711150"} 2023-07-11 18:05:11,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=20, state=RUNNABLE; OpenRegionProcedure c41300b446f1c31843a2ac322189ac5c, server=jenkins-hbase9.apache.org,38785,1689098706958}] 2023-07-11 18:05:11,159 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=8360d53793b402665c7d088b5757078c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,159 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711159"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711159"}]},"ts":"1689098711159"} 2023-07-11 18:05:11,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=30, state=RUNNABLE; OpenRegionProcedure 8360d53793b402665c7d088b5757078c, server=jenkins-hbase9.apache.org,38785,1689098706958}] 2023-07-11 18:05:11,167 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=12ffd9ba99aec19d05a9a4bdc190df5e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,167 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711167"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711167"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711167"}]},"ts":"1689098711167"} 2023-07-11 18:05:11,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=38, ppid=27, state=RUNNABLE; OpenRegionProcedure 12ffd9ba99aec19d05a9a4bdc190df5e, server=jenkins-hbase9.apache.org,38785,1689098706958}] 2023-07-11 18:05:11,174 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6fd79949daf97fb71187ed6ccb826c85, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,174 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711174"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711174"}]},"ts":"1689098711174"} 2023-07-11 18:05:11,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=17, state=RUNNABLE; OpenRegionProcedure 6fd79949daf97fb71187ed6ccb826c85, server=jenkins-hbase9.apache.org,38785,1689098706958}] 2023-07-11 18:05:11,180 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=082ae0e1538d0ea4afa6018633714d86, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,181 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711180"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711180"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711180"}]},"ts":"1689098711180"} 2023-07-11 18:05:11,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=32, state=RUNNABLE; OpenRegionProcedure 082ae0e1538d0ea4afa6018633714d86, server=jenkins-hbase9.apache.org,38785,1689098706958}] 2023-07-11 18:05:11,187 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=9e32425e5b5ae93a85c8ed8a3e29ad2a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,187 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711187"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711187"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711187"}]},"ts":"1689098711187"} 2023-07-11 18:05:11,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=24, state=RUNNABLE; OpenRegionProcedure 9e32425e5b5ae93a85c8ed8a3e29ad2a, server=jenkins-hbase9.apache.org,38785,1689098706958}] 2023-07-11 18:05:11,193 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e6114557edd3e2be4679297c99dbb707, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,194 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689098711193"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711193"}]},"ts":"1689098711193"} 2023-07-11 18:05:11,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=42, ppid=10, state=RUNNABLE; OpenRegionProcedure e6114557edd3e2be4679297c99dbb707, server=jenkins-hbase9.apache.org,38785,1689098706958}] 2023-07-11 18:05:11,199 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=34ae1cb300031e6413911b11bb3c0613, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,199 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711199"}]},"ts":"1689098711199"} 2023-07-11 18:05:11,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=14, state=RUNNABLE; OpenRegionProcedure 34ae1cb300031e6413911b11bb3c0613, server=jenkins-hbase9.apache.org,38785,1689098706958}] 2023-07-11 18:05:11,206 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=f32630ccb5e2306ee100dad5b0bd664e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,206 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689098711206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711206"}]},"ts":"1689098711206"} 2023-07-11 18:05:11,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=35, state=RUNNABLE; OpenRegionProcedure f32630ccb5e2306ee100dad5b0bd664e, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:05:11,212 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a535c854541161846ee0519898cadf3f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,212 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711212"}]},"ts":"1689098711212"} 2023-07-11 18:05:11,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=15, state=RUNNABLE; OpenRegionProcedure a535c854541161846ee0519898cadf3f, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:05:11,218 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=3a49a7d0f0c324e9e04b887b069379ae, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,218 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711218"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711218"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711218"}]},"ts":"1689098711218"} 2023-07-11 18:05:11,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=26, state=RUNNABLE; OpenRegionProcedure 3a49a7d0f0c324e9e04b887b069379ae, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:05:11,224 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=f4618a109b5b547019676f2a63009dd7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,224 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711224"}]},"ts":"1689098711224"} 2023-07-11 18:05:11,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=33, state=RUNNABLE; OpenRegionProcedure f4618a109b5b547019676f2a63009dd7, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:05:11,229 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ca97340b0ab43753a8263ae334c5b475, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,230 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711229"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711229"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711229"}]},"ts":"1689098711229"} 2023-07-11 18:05:11,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=18, state=RUNNABLE; OpenRegionProcedure ca97340b0ab43753a8263ae334c5b475, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:05:11,235 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=01c403825db7c339c13e2f1101543b42, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,235 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711235"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711235"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711235"}]},"ts":"1689098711235"} 2023-07-11 18:05:11,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=21, state=RUNNABLE; OpenRegionProcedure 01c403825db7c339c13e2f1101543b42, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:05:11,240 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1851532129addae5c0e78c4af9fe4b41, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,240 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711240"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711240"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711240"}]},"ts":"1689098711240"} 2023-07-11 18:05:11,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=23, state=RUNNABLE; OpenRegionProcedure 1851532129addae5c0e78c4af9fe4b41, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:05:11,245 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cfeeac3165a77206892059eaf409a93a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,245 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711245"}]},"ts":"1689098711245"} 2023-07-11 18:05:11,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=11, state=RUNNABLE; OpenRegionProcedure cfeeac3165a77206892059eaf409a93a, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:05:11,251 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cc5337c98b33958209dee082b9968414, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,251 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711251"}]},"ts":"1689098711251"} 2023-07-11 18:05:11,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=29, state=RUNNABLE; OpenRegionProcedure cc5337c98b33958209dee082b9968414, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:05:11,256 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3fda35ffdbf54a7596d1f6e9dd4c3a45, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,256 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711256"}]},"ts":"1689098711256"} 2023-07-11 18:05:11,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=28, state=RUNNABLE; OpenRegionProcedure 3fda35ffdbf54a7596d1f6e9dd4c3a45, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:05:11,264 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=68a671ac00030280ed3c9b59840a157c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,264 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711264"}]},"ts":"1689098711264"} 2023-07-11 18:05:11,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=12, state=RUNNABLE; OpenRegionProcedure 68a671ac00030280ed3c9b59840a157c, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:05:11,272 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=697385c0414f8f3b285f33f1ce166651, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,272 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711272"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711272"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711272"}]},"ts":"1689098711272"} 2023-07-11 18:05:11,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=25, state=RUNNABLE; OpenRegionProcedure 697385c0414f8f3b285f33f1ce166651, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:05:11,277 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=66f3e358060a5746d9b9f7c8e30affd1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,277 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711277"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711277"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711277"}]},"ts":"1689098711277"} 2023-07-11 18:05:11,279 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=31, state=RUNNABLE; OpenRegionProcedure 66f3e358060a5746d9b9f7c8e30affd1, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:05:11,283 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=9d068f7fd612d2e21c191a1d38a29723, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,283 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711282"}]},"ts":"1689098711282"} 2023-07-11 18:05:11,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=19, state=RUNNABLE; OpenRegionProcedure 9d068f7fd612d2e21c191a1d38a29723, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:05:11,288 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=9dd9757b1ce8f958386c6599a273f3ee, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,288 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711287"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711287"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711287"}]},"ts":"1689098711287"} 2023-07-11 18:05:11,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 18:05:11,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=34, state=RUNNABLE; OpenRegionProcedure 9dd9757b1ce8f958386c6599a273f3ee, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:05:11,293 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=c07a104cc172022c4212e2e7a10199ba, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,293 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711293"}]},"ts":"1689098711293"} 2023-07-11 18:05:11,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=59, ppid=22, state=RUNNABLE; OpenRegionProcedure c07a104cc172022c4212e2e7a10199ba, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:05:11,302 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=66c52954a1e65ac4eea3ad65ab781210, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,302 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711302"}]},"ts":"1689098711302"} 2023-07-11 18:05:11,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=13, state=RUNNABLE; OpenRegionProcedure 66c52954a1e65ac4eea3ad65ab781210, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:05:11,308 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1e821bd6d21478c1aef93851d0f84803, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,308 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098711308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098711308"}]},"ts":"1689098711308"} 2023-07-11 18:05:11,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=16, state=RUNNABLE; OpenRegionProcedure 1e821bd6d21478c1aef93851d0f84803, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:05:11,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:05:11,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6fd79949daf97fb71187ed6ccb826c85, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85.', STARTKEY => 'hhh', ENDKEY => 'iii'} 2023-07-11 18:05:11,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:05:11,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:05:11,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:05:11,318 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:05:11,320 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily11 2023-07-11 18:05:11,320 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily11 2023-07-11 18:05:11,321 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fd79949daf97fb71187ed6ccb826c85 columnFamilyName colfamily11 2023-07-11 18:05:11,322 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(310): Store=6fd79949daf97fb71187ed6ccb826c85/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,322 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:05:11,324 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily21 2023-07-11 18:05:11,324 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily21 2023-07-11 18:05:11,324 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fd79949daf97fb71187ed6ccb826c85 columnFamilyName colfamily21 2023-07-11 18:05:11,325 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(310): Store=6fd79949daf97fb71187ed6ccb826c85/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,325 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:05:11,327 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily31 2023-07-11 18:05:11,327 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily31 2023-07-11 18:05:11,328 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fd79949daf97fb71187ed6ccb826c85 columnFamilyName colfamily31 2023-07-11 18:05:11,328 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(310): Store=6fd79949daf97fb71187ed6ccb826c85/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:05:11,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:05:11,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:05:11,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 6fd79949daf97fb71187ed6ccb826c85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73646154, jitterRate=0.09741321206092834}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 6fd79949daf97fb71187ed6ccb826c85: 2023-07-11 18:05:11,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85., pid=39, masterSystemTime=1689098711307 2023-07-11 18:05:11,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:05:11,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:05:11,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:05:11,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e32425e5b5ae93a85c8ed8a3e29ad2a, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a.', STARTKEY => 'ooo', ENDKEY => 'ppp'} 2023-07-11 18:05:11,348 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6fd79949daf97fb71187ed6ccb826c85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,348 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711348"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711348"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711348"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711348"}]},"ts":"1689098711348"} 2023-07-11 18:05:11,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:05:11,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:05:11,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:05:11,353 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:05:11,356 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily11 2023-07-11 18:05:11,356 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily11 2023-07-11 18:05:11,357 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e32425e5b5ae93a85c8ed8a3e29ad2a columnFamilyName colfamily11 2023-07-11 18:05:11,358 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(310): Store=9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,358 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:05:11,360 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily21 2023-07-11 18:05:11,360 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily21 2023-07-11 18:05:11,361 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,361 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:05:11,362 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e32425e5b5ae93a85c8ed8a3e29ad2a columnFamilyName colfamily21 2023-07-11 18:05:11,363 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(310): Store=9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,363 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:05:11,366 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 18:05:11,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=17 2023-07-11 18:05:11,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=17, state=SUCCESS; OpenRegionProcedure 6fd79949daf97fb71187ed6ccb826c85, server=jenkins-hbase9.apache.org,38785,1689098706958 in 179 msec 2023-07-11 18:05:11,368 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily31 2023-07-11 18:05:11,369 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily31 2023-07-11 18:05:11,370 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e32425e5b5ae93a85c8ed8a3e29ad2a columnFamilyName colfamily31 2023-07-11 18:05:11,371 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(310): Store=9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fd79949daf97fb71187ed6ccb826c85, ASSIGN in 389 msec 2023-07-11 18:05:11,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:05:11,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f4618a109b5b547019676f2a63009dd7, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2023-07-11 18:05:11,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true f4618a109b5b547019676f2a63009dd7 2023-07-11 18:05:11,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f4618a109b5b547019676f2a63009dd7 2023-07-11 18:05:11,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f4618a109b5b547019676f2a63009dd7 2023-07-11 18:05:11,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:05:11,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:05:11,380 INFO [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region f4618a109b5b547019676f2a63009dd7 2023-07-11 18:05:11,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,382 DEBUG [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/colfamily11 2023-07-11 18:05:11,382 DEBUG [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/colfamily11 2023-07-11 18:05:11,382 INFO [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4618a109b5b547019676f2a63009dd7 columnFamilyName colfamily11 2023-07-11 18:05:11,383 INFO [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] regionserver.HStore(310): Store=f4618a109b5b547019676f2a63009dd7/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,383 INFO [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region f4618a109b5b547019676f2a63009dd7 2023-07-11 18:05:11,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:05:11,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9e32425e5b5ae93a85c8ed8a3e29ad2a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72535948, jitterRate=0.08086985349655151}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9e32425e5b5ae93a85c8ed8a3e29ad2a: 2023-07-11 18:05:11,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a., pid=41, masterSystemTime=1689098711307 2023-07-11 18:05:11,390 DEBUG [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/colfamily21 2023-07-11 18:05:11,391 DEBUG [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/colfamily21 2023-07-11 18:05:11,393 INFO [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4618a109b5b547019676f2a63009dd7 columnFamilyName colfamily21 2023-07-11 18:05:11,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:05:11,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:05:11,394 INFO [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] regionserver.HStore(310): Store=f4618a109b5b547019676f2a63009dd7/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:05:11,395 INFO [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region f4618a109b5b547019676f2a63009dd7 2023-07-11 18:05:11,395 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=9e32425e5b5ae93a85c8ed8a3e29ad2a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8360d53793b402665c7d088b5757078c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2023-07-11 18:05:11,395 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711395"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711395"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711395"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711395"}]},"ts":"1689098711395"} 2023-07-11 18:05:11,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 8360d53793b402665c7d088b5757078c 2023-07-11 18:05:11,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8360d53793b402665c7d088b5757078c 2023-07-11 18:05:11,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8360d53793b402665c7d088b5757078c 2023-07-11 18:05:11,398 DEBUG [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/colfamily31 2023-07-11 18:05:11,398 DEBUG [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/colfamily31 2023-07-11 18:05:11,399 INFO [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4618a109b5b547019676f2a63009dd7 columnFamilyName colfamily31 2023-07-11 18:05:11,400 INFO [StoreOpener-f4618a109b5b547019676f2a63009dd7-1] regionserver.HStore(310): Store=f4618a109b5b547019676f2a63009dd7/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=24 2023-07-11 18:05:11,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=24, state=SUCCESS; OpenRegionProcedure 9e32425e5b5ae93a85c8ed8a3e29ad2a, server=jenkins-hbase9.apache.org,38785,1689098706958 in 209 msec 2023-07-11 18:05:11,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e32425e5b5ae93a85c8ed8a3e29ad2a, ASSIGN in 423 msec 2023-07-11 18:05:11,406 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 8360d53793b402665c7d088b5757078c 2023-07-11 18:05:11,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7 2023-07-11 18:05:11,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7 2023-07-11 18:05:11,410 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily11 2023-07-11 18:05:11,410 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily11 2023-07-11 18:05:11,411 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8360d53793b402665c7d088b5757078c columnFamilyName colfamily11 2023-07-11 18:05:11,411 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(310): Store=8360d53793b402665c7d088b5757078c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,412 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 8360d53793b402665c7d088b5757078c 2023-07-11 18:05:11,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,413 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,413 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:05:11,416 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily21 2023-07-11 18:05:11,416 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily21 2023-07-11 18:05:11,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f4618a109b5b547019676f2a63009dd7 2023-07-11 18:05:11,417 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8360d53793b402665c7d088b5757078c columnFamilyName colfamily21 2023-07-11 18:05:11,419 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(310): Store=8360d53793b402665c7d088b5757078c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,419 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 8360d53793b402665c7d088b5757078c 2023-07-11 18:05:11,421 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily31 2023-07-11 18:05:11,421 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily31 2023-07-11 18:05:11,421 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8360d53793b402665c7d088b5757078c columnFamilyName colfamily31 2023-07-11 18:05:11,422 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(310): Store=8360d53793b402665c7d088b5757078c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c 2023-07-11 18:05:11,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c 2023-07-11 18:05:11,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,438 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 18:05:11,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8360d53793b402665c7d088b5757078c 2023-07-11 18:05:11,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f4618a109b5b547019676f2a63009dd7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71514936, jitterRate=0.06565558910369873}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f4618a109b5b547019676f2a63009dd7: 2023-07-11 18:05:11,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8360d53793b402665c7d088b5757078c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73607215, jitterRate=0.09683297574520111}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8360d53793b402665c7d088b5757078c: 2023-07-11 18:05:11,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7., pid=47, masterSystemTime=1689098711361 2023-07-11 18:05:11,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:05:11,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d068f7fd612d2e21c191a1d38a29723, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2023-07-11 18:05:11,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:05:11,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c., pid=37, masterSystemTime=1689098711307 2023-07-11 18:05:11,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:05:11,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:05:11,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:05:11,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:05:11,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:05:11,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1851532129addae5c0e78c4af9fe4b41, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2023-07-11 18:05:11,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:05:11,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:05:11,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:05:11,464 INFO [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:05:11,465 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=f4618a109b5b547019676f2a63009dd7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:05:11,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:05:11,465 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711465"}]},"ts":"1689098711465"} 2023-07-11 18:05:11,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:05:11,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12ffd9ba99aec19d05a9a4bdc190df5e, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e.', STARTKEY => 'rrr', ENDKEY => 'sss'} 2023-07-11 18:05:11,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:05:11,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:05:11,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:05:11,471 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=33 2023-07-11 18:05:11,471 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=33, state=SUCCESS; OpenRegionProcedure f4618a109b5b547019676f2a63009dd7, server=jenkins-hbase9.apache.org,36619,1689098707062 in 242 msec 2023-07-11 18:05:11,475 INFO [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:05:11,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f4618a109b5b547019676f2a63009dd7, ASSIGN in 492 msec 2023-07-11 18:05:11,476 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=8360d53793b402665c7d088b5757078c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,476 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711476"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711476"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711476"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711476"}]},"ts":"1689098711476"} 2023-07-11 18:05:11,479 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:05:11,479 DEBUG [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/colfamily11 2023-07-11 18:05:11,479 DEBUG [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/colfamily11 2023-07-11 18:05:11,480 INFO [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d068f7fd612d2e21c191a1d38a29723 columnFamilyName colfamily11 2023-07-11 18:05:11,481 INFO [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] regionserver.HStore(310): Store=9d068f7fd612d2e21c191a1d38a29723/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,481 INFO [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:05:11,482 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily11 2023-07-11 18:05:11,482 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily11 2023-07-11 18:05:11,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=30 2023-07-11 18:05:11,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=30, state=SUCCESS; OpenRegionProcedure 8360d53793b402665c7d088b5757078c, server=jenkins-hbase9.apache.org,38785,1689098706958 in 317 msec 2023-07-11 18:05:11,483 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12ffd9ba99aec19d05a9a4bdc190df5e columnFamilyName colfamily11 2023-07-11 18:05:11,483 DEBUG [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/colfamily21 2023-07-11 18:05:11,483 DEBUG [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/colfamily21 2023-07-11 18:05:11,484 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(310): Store=12ffd9ba99aec19d05a9a4bdc190df5e/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,484 INFO [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d068f7fd612d2e21c191a1d38a29723 columnFamilyName colfamily21 2023-07-11 18:05:11,484 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:05:11,484 DEBUG [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/colfamily11 2023-07-11 18:05:11,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8360d53793b402665c7d088b5757078c, ASSIGN in 502 msec 2023-07-11 18:05:11,484 INFO [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] regionserver.HStore(310): Store=9d068f7fd612d2e21c191a1d38a29723/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,485 DEBUG [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/colfamily11 2023-07-11 18:05:11,485 INFO [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:05:11,485 INFO [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1851532129addae5c0e78c4af9fe4b41 columnFamilyName colfamily11 2023-07-11 18:05:11,487 INFO [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] regionserver.HStore(310): Store=1851532129addae5c0e78c4af9fe4b41/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,487 INFO [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:05:11,487 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily21 2023-07-11 18:05:11,487 DEBUG [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/colfamily31 2023-07-11 18:05:11,487 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily21 2023-07-11 18:05:11,487 DEBUG [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/colfamily31 2023-07-11 18:05:11,488 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12ffd9ba99aec19d05a9a4bdc190df5e columnFamilyName colfamily21 2023-07-11 18:05:11,488 INFO [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d068f7fd612d2e21c191a1d38a29723 columnFamilyName colfamily31 2023-07-11 18:05:11,489 INFO [StoreOpener-9d068f7fd612d2e21c191a1d38a29723-1] regionserver.HStore(310): Store=9d068f7fd612d2e21c191a1d38a29723/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,490 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(310): Store=12ffd9ba99aec19d05a9a4bdc190df5e/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,491 DEBUG [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/colfamily21 2023-07-11 18:05:11,491 DEBUG [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/colfamily21 2023-07-11 18:05:11,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:05:11,491 INFO [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1851532129addae5c0e78c4af9fe4b41 columnFamilyName colfamily21 2023-07-11 18:05:11,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:05:11,492 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:05:11,492 INFO [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] regionserver.HStore(310): Store=1851532129addae5c0e78c4af9fe4b41/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,492 INFO [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:05:11,497 DEBUG [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/colfamily31 2023-07-11 18:05:11,497 DEBUG [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/colfamily31 2023-07-11 18:05:11,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,498 INFO [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1851532129addae5c0e78c4af9fe4b41 columnFamilyName colfamily31 2023-07-11 18:05:11,498 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily31 2023-07-11 18:05:11,498 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily31 2023-07-11 18:05:11,498 INFO [StoreOpener-1851532129addae5c0e78c4af9fe4b41-1] regionserver.HStore(310): Store=1851532129addae5c0e78c4af9fe4b41/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,499 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12ffd9ba99aec19d05a9a4bdc190df5e columnFamilyName colfamily31 2023-07-11 18:05:11,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:05:11,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:05:11,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:05:11,502 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(310): Store=12ffd9ba99aec19d05a9a4bdc190df5e/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:05:11,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:05:11,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9d068f7fd612d2e21c191a1d38a29723; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70591055, jitterRate=0.051888689398765564}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9d068f7fd612d2e21c191a1d38a29723: 2023-07-11 18:05:11,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:05:11,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:05:11,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1851532129addae5c0e78c4af9fe4b41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58997708, jitterRate=-0.12086564302444458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1851532129addae5c0e78c4af9fe4b41: 2023-07-11 18:05:11,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41., pid=50, masterSystemTime=1689098711361 2023-07-11 18:05:11,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723., pid=57, masterSystemTime=1689098711413 2023-07-11 18:05:11,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 12ffd9ba99aec19d05a9a4bdc190df5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71858506, jitterRate=0.07077518105506897}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 12ffd9ba99aec19d05a9a4bdc190df5e: 2023-07-11 18:05:11,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:05:11,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:05:11,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:05:11,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f32630ccb5e2306ee100dad5b0bd664e, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e.', STARTKEY => 'zzz', ENDKEY => ''} 2023-07-11 18:05:11,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:05:11,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e., pid=38, masterSystemTime=1689098711307 2023-07-11 18:05:11,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,522 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1851532129addae5c0e78c4af9fe4b41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,523 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711522"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711522"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711522"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711522"}]},"ts":"1689098711522"} 2023-07-11 18:05:11,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:05:11,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:05:11,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:05:11,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:05:11,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:05:11,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3fda35ffdbf54a7596d1f6e9dd4c3a45, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2023-07-11 18:05:11,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:05:11,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:05:11,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:05:11,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:05:11,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:05:11,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:05:11,527 INFO [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:05:11,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c41300b446f1c31843a2ac322189ac5c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2023-07-11 18:05:11,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:05:11,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:05:11,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:05:11,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=23 2023-07-11 18:05:11,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=23, state=SUCCESS; OpenRegionProcedure 1851532129addae5c0e78c4af9fe4b41, server=jenkins-hbase9.apache.org,36619,1689098707062 in 285 msec 2023-07-11 18:05:11,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1851532129addae5c0e78c4af9fe4b41, ASSIGN in 553 msec 2023-07-11 18:05:11,534 INFO [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:05:11,534 DEBUG [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/colfamily11 2023-07-11 18:05:11,534 DEBUG [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/colfamily11 2023-07-11 18:05:11,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=12ffd9ba99aec19d05a9a4bdc190df5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,535 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711535"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711535"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711535"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711535"}]},"ts":"1689098711535"} 2023-07-11 18:05:11,535 INFO [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f32630ccb5e2306ee100dad5b0bd664e columnFamilyName colfamily11 2023-07-11 18:05:11,537 INFO [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] regionserver.HStore(310): Store=f32630ccb5e2306ee100dad5b0bd664e/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,537 INFO [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:05:11,541 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:05:11,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=27 2023-07-11 18:05:11,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=27, state=SUCCESS; OpenRegionProcedure 12ffd9ba99aec19d05a9a4bdc190df5e, server=jenkins-hbase9.apache.org,38785,1689098706958 in 369 msec 2023-07-11 18:05:11,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=12ffd9ba99aec19d05a9a4bdc190df5e, ASSIGN in 564 msec 2023-07-11 18:05:11,545 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=9d068f7fd612d2e21c191a1d38a29723, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,545 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711545"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711545"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711545"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711545"}]},"ts":"1689098711545"} 2023-07-11 18:05:11,547 DEBUG [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/colfamily21 2023-07-11 18:05:11,547 DEBUG [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/colfamily21 2023-07-11 18:05:11,548 DEBUG [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/colfamily11 2023-07-11 18:05:11,548 DEBUG [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/colfamily11 2023-07-11 18:05:11,548 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily11 2023-07-11 18:05:11,548 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily11 2023-07-11 18:05:11,548 INFO [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fda35ffdbf54a7596d1f6e9dd4c3a45 columnFamilyName colfamily11 2023-07-11 18:05:11,549 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c41300b446f1c31843a2ac322189ac5c columnFamilyName colfamily11 2023-07-11 18:05:11,548 INFO [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f32630ccb5e2306ee100dad5b0bd664e columnFamilyName colfamily21 2023-07-11 18:05:11,550 INFO [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] regionserver.HStore(310): Store=3fda35ffdbf54a7596d1f6e9dd4c3a45/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,550 INFO [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:05:11,551 INFO [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] regionserver.HStore(310): Store=f32630ccb5e2306ee100dad5b0bd664e/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,551 INFO [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:05:11,552 DEBUG [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/colfamily21 2023-07-11 18:05:11,552 DEBUG [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/colfamily21 2023-07-11 18:05:11,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=19 2023-07-11 18:05:11,552 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(310): Store=c41300b446f1c31843a2ac322189ac5c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=19, state=SUCCESS; OpenRegionProcedure 9d068f7fd612d2e21c191a1d38a29723, server=jenkins-hbase9.apache.org,33801,1689098707010 in 264 msec 2023-07-11 18:05:11,553 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:05:11,553 INFO [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fda35ffdbf54a7596d1f6e9dd4c3a45 columnFamilyName colfamily21 2023-07-11 18:05:11,554 DEBUG [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/colfamily31 2023-07-11 18:05:11,554 DEBUG [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/colfamily31 2023-07-11 18:05:11,554 INFO [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] regionserver.HStore(310): Store=3fda35ffdbf54a7596d1f6e9dd4c3a45/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,554 INFO [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:05:11,554 INFO [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f32630ccb5e2306ee100dad5b0bd664e columnFamilyName colfamily31 2023-07-11 18:05:11,555 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily21 2023-07-11 18:05:11,555 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily21 2023-07-11 18:05:11,556 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c41300b446f1c31843a2ac322189ac5c columnFamilyName colfamily21 2023-07-11 18:05:11,556 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(310): Store=c41300b446f1c31843a2ac322189ac5c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9d068f7fd612d2e21c191a1d38a29723, ASSIGN in 575 msec 2023-07-11 18:05:11,556 DEBUG [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/colfamily31 2023-07-11 18:05:11,557 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:05:11,557 DEBUG [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/colfamily31 2023-07-11 18:05:11,557 INFO [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fda35ffdbf54a7596d1f6e9dd4c3a45 columnFamilyName colfamily31 2023-07-11 18:05:11,558 INFO [StoreOpener-f32630ccb5e2306ee100dad5b0bd664e-1] regionserver.HStore(310): Store=f32630ccb5e2306ee100dad5b0bd664e/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,558 INFO [StoreOpener-3fda35ffdbf54a7596d1f6e9dd4c3a45-1] regionserver.HStore(310): Store=3fda35ffdbf54a7596d1f6e9dd4c3a45/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,560 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily31 2023-07-11 18:05:11,560 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily31 2023-07-11 18:05:11,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:05:11,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:05:11,561 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c41300b446f1c31843a2ac322189ac5c columnFamilyName colfamily31 2023-07-11 18:05:11,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:05:11,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:05:11,562 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(310): Store=c41300b446f1c31843a2ac322189ac5c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:05:11,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:05:11,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:05:11,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:05:11,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3fda35ffdbf54a7596d1f6e9dd4c3a45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71990804, jitterRate=0.07274657487869263}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3fda35ffdbf54a7596d1f6e9dd4c3a45: 2023-07-11 18:05:11,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:05:11,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45., pid=53, masterSystemTime=1689098711413 2023-07-11 18:05:11,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:05:11,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:05:11,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:05:11,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 66c52954a1e65ac4eea3ad65ab781210, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2023-07-11 18:05:11,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:05:11,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:05:11,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:05:11,578 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3fda35ffdbf54a7596d1f6e9dd4c3a45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,578 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711578"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711578"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711578"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711578"}]},"ts":"1689098711578"} 2023-07-11 18:05:11,583 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=28 2023-07-11 18:05:11,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=28, state=SUCCESS; OpenRegionProcedure 3fda35ffdbf54a7596d1f6e9dd4c3a45, server=jenkins-hbase9.apache.org,33801,1689098707010 in 323 msec 2023-07-11 18:05:11,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3fda35ffdbf54a7596d1f6e9dd4c3a45, ASSIGN in 604 msec 2023-07-11 18:05:11,586 INFO [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:05:11,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c41300b446f1c31843a2ac322189ac5c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61252207, jitterRate=-0.08727099001407623}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c41300b446f1c31843a2ac322189ac5c: 2023-07-11 18:05:11,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f32630ccb5e2306ee100dad5b0bd664e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62487332, jitterRate=-0.06886619329452515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,591 DEBUG [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/colfamily11 2023-07-11 18:05:11,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c., pid=36, masterSystemTime=1689098711307 2023-07-11 18:05:11,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f32630ccb5e2306ee100dad5b0bd664e: 2023-07-11 18:05:11,592 DEBUG [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/colfamily11 2023-07-11 18:05:11,593 INFO [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66c52954a1e65ac4eea3ad65ab781210 columnFamilyName colfamily11 2023-07-11 18:05:11,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e., pid=44, masterSystemTime=1689098711361 2023-07-11 18:05:11,594 INFO [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] regionserver.HStore(310): Store=66c52954a1e65ac4eea3ad65ab781210/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,594 INFO [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:05:11,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:05:11,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:05:11,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:05:11,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 082ae0e1538d0ea4afa6018633714d86, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86.', STARTKEY => 'www', ENDKEY => 'xxx'} 2023-07-11 18:05:11,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:05:11,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:05:11,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:05:11,598 DEBUG [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/colfamily21 2023-07-11 18:05:11,598 DEBUG [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/colfamily21 2023-07-11 18:05:11,598 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c41300b446f1c31843a2ac322189ac5c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,598 INFO [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66c52954a1e65ac4eea3ad65ab781210 columnFamilyName colfamily21 2023-07-11 18:05:11,598 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711598"}]},"ts":"1689098711598"} 2023-07-11 18:05:11,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:05:11,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:05:11,599 INFO [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] regionserver.HStore(310): Store=66c52954a1e65ac4eea3ad65ab781210/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:05:11,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca97340b0ab43753a8263ae334c5b475, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2023-07-11 18:05:11,600 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:05:11,600 INFO [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:05:11,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:05:11,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:05:11,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:05:11,603 DEBUG [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/colfamily31 2023-07-11 18:05:11,603 DEBUG [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/colfamily31 2023-07-11 18:05:11,603 INFO [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66c52954a1e65ac4eea3ad65ab781210 columnFamilyName colfamily31 2023-07-11 18:05:11,604 INFO [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:05:11,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=20 2023-07-11 18:05:11,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=20, state=SUCCESS; OpenRegionProcedure c41300b446f1c31843a2ac322189ac5c, server=jenkins-hbase9.apache.org,38785,1689098706958 in 447 msec 2023-07-11 18:05:11,605 INFO [StoreOpener-66c52954a1e65ac4eea3ad65ab781210-1] regionserver.HStore(310): Store=66c52954a1e65ac4eea3ad65ab781210/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,607 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily11 2023-07-11 18:05:11,607 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily11 2023-07-11 18:05:11,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:05:11,607 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 082ae0e1538d0ea4afa6018633714d86 columnFamilyName colfamily11 2023-07-11 18:05:11,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:05:11,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c41300b446f1c31843a2ac322189ac5c, ASSIGN in 626 msec 2023-07-11 18:05:11,609 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=f32630ccb5e2306ee100dad5b0bd664e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,609 DEBUG [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/colfamily11 2023-07-11 18:05:11,609 DEBUG [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/colfamily11 2023-07-11 18:05:11,609 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689098711609"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711609"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711609"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711609"}]},"ts":"1689098711609"} 2023-07-11 18:05:11,610 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(310): Store=082ae0e1538d0ea4afa6018633714d86/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,610 INFO [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca97340b0ab43753a8263ae334c5b475 columnFamilyName colfamily11 2023-07-11 18:05:11,611 INFO [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] regionserver.HStore(310): Store=ca97340b0ab43753a8263ae334c5b475/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,611 INFO [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:05:11,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,610 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:05:11,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:05:11,615 DEBUG [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/colfamily21 2023-07-11 18:05:11,615 DEBUG [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/colfamily21 2023-07-11 18:05:11,616 INFO [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca97340b0ab43753a8263ae334c5b475 columnFamilyName colfamily21 2023-07-11 18:05:11,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=35 2023-07-11 18:05:11,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=35, state=SUCCESS; OpenRegionProcedure f32630ccb5e2306ee100dad5b0bd664e, server=jenkins-hbase9.apache.org,36619,1689098707062 in 404 msec 2023-07-11 18:05:11,617 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily21 2023-07-11 18:05:11,617 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily21 2023-07-11 18:05:11,617 INFO [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] regionserver.HStore(310): Store=ca97340b0ab43753a8263ae334c5b475/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,618 INFO [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:05:11,618 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 082ae0e1538d0ea4afa6018633714d86 columnFamilyName colfamily21 2023-07-11 18:05:11,619 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(310): Store=082ae0e1538d0ea4afa6018633714d86/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=f32630ccb5e2306ee100dad5b0bd664e, ASSIGN in 637 msec 2023-07-11 18:05:11,620 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:05:11,620 DEBUG [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/colfamily31 2023-07-11 18:05:11,620 DEBUG [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/colfamily31 2023-07-11 18:05:11,620 INFO [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca97340b0ab43753a8263ae334c5b475 columnFamilyName colfamily31 2023-07-11 18:05:11,621 INFO [StoreOpener-ca97340b0ab43753a8263ae334c5b475-1] regionserver.HStore(310): Store=ca97340b0ab43753a8263ae334c5b475/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,621 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily31 2023-07-11 18:05:11,621 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily31 2023-07-11 18:05:11,623 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 082ae0e1538d0ea4afa6018633714d86 columnFamilyName colfamily31 2023-07-11 18:05:11,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,624 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(310): Store=082ae0e1538d0ea4afa6018633714d86/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:05:11,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:05:11,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 66c52954a1e65ac4eea3ad65ab781210; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60569856, jitterRate=-0.09743881225585938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:05:11,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 66c52954a1e65ac4eea3ad65ab781210: 2023-07-11 18:05:11,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:05:11,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210., pid=60, masterSystemTime=1689098711413 2023-07-11 18:05:11,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:05:11,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:05:11,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:05:11,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 66f3e358060a5746d9b9f7c8e30affd1, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1.', STARTKEY => 'vvv', ENDKEY => 'www'} 2023-07-11 18:05:11,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:05:11,632 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=66c52954a1e65ac4eea3ad65ab781210, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,633 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711632"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711632"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711632"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711632"}]},"ts":"1689098711632"} 2023-07-11 18:05:11,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:05:11,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:05:11,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:05:11,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:05:11,638 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=13 2023-07-11 18:05:11,639 INFO [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:05:11,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=13, state=SUCCESS; OpenRegionProcedure 66c52954a1e65ac4eea3ad65ab781210, server=jenkins-hbase9.apache.org,33801,1689098707010 in 332 msec 2023-07-11 18:05:11,641 DEBUG [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/colfamily11 2023-07-11 18:05:11,641 DEBUG [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/colfamily11 2023-07-11 18:05:11,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66c52954a1e65ac4eea3ad65ab781210, ASSIGN in 661 msec 2023-07-11 18:05:11,642 INFO [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66f3e358060a5746d9b9f7c8e30affd1 columnFamilyName colfamily11 2023-07-11 18:05:11,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,643 INFO [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] regionserver.HStore(310): Store=66f3e358060a5746d9b9f7c8e30affd1/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 082ae0e1538d0ea4afa6018633714d86; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73834381, jitterRate=0.10021801292896271}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,643 INFO [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:05:11,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 082ae0e1538d0ea4afa6018633714d86: 2023-07-11 18:05:11,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ca97340b0ab43753a8263ae334c5b475; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64649854, jitterRate=-0.036642104387283325}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ca97340b0ab43753a8263ae334c5b475: 2023-07-11 18:05:11,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86., pid=40, masterSystemTime=1689098711307 2023-07-11 18:05:11,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475., pid=48, masterSystemTime=1689098711361 2023-07-11 18:05:11,645 DEBUG [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/colfamily21 2023-07-11 18:05:11,645 DEBUG [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/colfamily21 2023-07-11 18:05:11,647 INFO [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66f3e358060a5746d9b9f7c8e30affd1 columnFamilyName colfamily21 2023-07-11 18:05:11,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:05:11,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:05:11,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:05:11,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6114557edd3e2be4679297c99dbb707, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707.', STARTKEY => '', ENDKEY => 'bbb'} 2023-07-11 18:05:11,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true e6114557edd3e2be4679297c99dbb707 2023-07-11 18:05:11,648 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=082ae0e1538d0ea4afa6018633714d86, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,649 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711648"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711648"}]},"ts":"1689098711648"} 2023-07-11 18:05:11,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e6114557edd3e2be4679297c99dbb707 2023-07-11 18:05:11,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e6114557edd3e2be4679297c99dbb707 2023-07-11 18:05:11,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:05:11,649 INFO [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] regionserver.HStore(310): Store=66f3e358060a5746d9b9f7c8e30affd1/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:05:11,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:05:11,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cfeeac3165a77206892059eaf409a93a, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2023-07-11 18:05:11,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true cfeeac3165a77206892059eaf409a93a 2023-07-11 18:05:11,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for cfeeac3165a77206892059eaf409a93a 2023-07-11 18:05:11,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for cfeeac3165a77206892059eaf409a93a 2023-07-11 18:05:11,651 INFO [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:05:11,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=32 2023-07-11 18:05:11,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=32, state=SUCCESS; OpenRegionProcedure 082ae0e1538d0ea4afa6018633714d86, server=jenkins-hbase9.apache.org,38785,1689098706958 in 469 msec 2023-07-11 18:05:11,656 DEBUG [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/colfamily31 2023-07-11 18:05:11,656 DEBUG [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/colfamily31 2023-07-11 18:05:11,657 INFO [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66f3e358060a5746d9b9f7c8e30affd1 columnFamilyName colfamily31 2023-07-11 18:05:11,657 INFO [StoreOpener-66f3e358060a5746d9b9f7c8e30affd1-1] regionserver.HStore(310): Store=66f3e358060a5746d9b9f7c8e30affd1/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=082ae0e1538d0ea4afa6018633714d86, ASSIGN in 676 msec 2023-07-11 18:05:11,664 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region e6114557edd3e2be4679297c99dbb707 2023-07-11 18:05:11,664 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ca97340b0ab43753a8263ae334c5b475, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,665 INFO [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region cfeeac3165a77206892059eaf409a93a 2023-07-11 18:05:11,665 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711664"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711664"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711664"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711664"}]},"ts":"1689098711664"} 2023-07-11 18:05:11,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:05:11,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:05:11,667 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily11 2023-07-11 18:05:11,667 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily11 2023-07-11 18:05:11,667 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6114557edd3e2be4679297c99dbb707 columnFamilyName colfamily11 2023-07-11 18:05:11,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=18 2023-07-11 18:05:11,671 DEBUG [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/colfamily11 2023-07-11 18:05:11,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=18, state=SUCCESS; OpenRegionProcedure ca97340b0ab43753a8263ae334c5b475, server=jenkins-hbase9.apache.org,36619,1689098707062 in 438 msec 2023-07-11 18:05:11,671 DEBUG [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/colfamily11 2023-07-11 18:05:11,672 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(310): Store=e6114557edd3e2be4679297c99dbb707/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,672 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region e6114557edd3e2be4679297c99dbb707 2023-07-11 18:05:11,672 INFO [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfeeac3165a77206892059eaf409a93a columnFamilyName colfamily11 2023-07-11 18:05:11,673 INFO [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] regionserver.HStore(310): Store=cfeeac3165a77206892059eaf409a93a/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,673 INFO [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region cfeeac3165a77206892059eaf409a93a 2023-07-11 18:05:11,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ca97340b0ab43753a8263ae334c5b475, ASSIGN in 694 msec 2023-07-11 18:05:11,675 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily21 2023-07-11 18:05:11,675 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily21 2023-07-11 18:05:11,675 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6114557edd3e2be4679297c99dbb707 columnFamilyName colfamily21 2023-07-11 18:05:11,675 DEBUG [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/colfamily21 2023-07-11 18:05:11,675 DEBUG [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/colfamily21 2023-07-11 18:05:11,676 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(310): Store=e6114557edd3e2be4679297c99dbb707/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,676 INFO [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfeeac3165a77206892059eaf409a93a columnFamilyName colfamily21 2023-07-11 18:05:11,676 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region e6114557edd3e2be4679297c99dbb707 2023-07-11 18:05:11,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:05:11,677 INFO [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] regionserver.HStore(310): Store=cfeeac3165a77206892059eaf409a93a/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,677 INFO [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region cfeeac3165a77206892059eaf409a93a 2023-07-11 18:05:11,678 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily31 2023-07-11 18:05:11,678 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily31 2023-07-11 18:05:11,679 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6114557edd3e2be4679297c99dbb707 columnFamilyName colfamily31 2023-07-11 18:05:11,679 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(310): Store=e6114557edd3e2be4679297c99dbb707/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,680 DEBUG [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/colfamily31 2023-07-11 18:05:11,680 DEBUG [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/colfamily31 2023-07-11 18:05:11,680 INFO [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfeeac3165a77206892059eaf409a93a columnFamilyName colfamily31 2023-07-11 18:05:11,681 INFO [StoreOpener-cfeeac3165a77206892059eaf409a93a-1] regionserver.HStore(310): Store=cfeeac3165a77206892059eaf409a93a/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a 2023-07-11 18:05:11,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707 2023-07-11 18:05:11,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a 2023-07-11 18:05:11,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 66f3e358060a5746d9b9f7c8e30affd1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60221289, jitterRate=-0.10263286530971527}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 66f3e358060a5746d9b9f7c8e30affd1: 2023-07-11 18:05:11,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707 2023-07-11 18:05:11,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1., pid=56, masterSystemTime=1689098711413 2023-07-11 18:05:11,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:05:11,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:05:11,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:05:11,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 68a671ac00030280ed3c9b59840a157c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2023-07-11 18:05:11,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 68a671ac00030280ed3c9b59840a157c 2023-07-11 18:05:11,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 68a671ac00030280ed3c9b59840a157c 2023-07-11 18:05:11,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 68a671ac00030280ed3c9b59840a157c 2023-07-11 18:05:11,695 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=66f3e358060a5746d9b9f7c8e30affd1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,695 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711694"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711694"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711694"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711694"}]},"ts":"1689098711694"} 2023-07-11 18:05:11,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for cfeeac3165a77206892059eaf409a93a 2023-07-11 18:05:11,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e6114557edd3e2be4679297c99dbb707 2023-07-11 18:05:11,701 INFO [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 68a671ac00030280ed3c9b59840a157c 2023-07-11 18:05:11,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=31 2023-07-11 18:05:11,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=31, state=SUCCESS; OpenRegionProcedure 66f3e358060a5746d9b9f7c8e30affd1, server=jenkins-hbase9.apache.org,33801,1689098707010 in 418 msec 2023-07-11 18:05:11,705 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66f3e358060a5746d9b9f7c8e30affd1, ASSIGN in 723 msec 2023-07-11 18:05:11,711 DEBUG [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/colfamily11 2023-07-11 18:05:11,711 DEBUG [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/colfamily11 2023-07-11 18:05:11,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,712 INFO [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68a671ac00030280ed3c9b59840a157c columnFamilyName colfamily11 2023-07-11 18:05:11,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened cfeeac3165a77206892059eaf409a93a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61645949, jitterRate=-0.08140377700328827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e6114557edd3e2be4679297c99dbb707; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73013724, jitterRate=0.08798927068710327}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,712 INFO [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] regionserver.HStore(310): Store=68a671ac00030280ed3c9b59840a157c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for cfeeac3165a77206892059eaf409a93a: 2023-07-11 18:05:11,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e6114557edd3e2be4679297c99dbb707: 2023-07-11 18:05:11,713 INFO [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 68a671ac00030280ed3c9b59840a157c 2023-07-11 18:05:11,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707., pid=42, masterSystemTime=1689098711307 2023-07-11 18:05:11,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a., pid=51, masterSystemTime=1689098711361 2023-07-11 18:05:11,715 DEBUG [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/colfamily21 2023-07-11 18:05:11,715 DEBUG [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/colfamily21 2023-07-11 18:05:11,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:05:11,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:05:11,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:05:11,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a49a7d0f0c324e9e04b887b069379ae, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2023-07-11 18:05:11,717 INFO [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68a671ac00030280ed3c9b59840a157c columnFamilyName colfamily21 2023-07-11 18:05:11,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:05:11,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:05:11,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:05:11,718 INFO [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] regionserver.HStore(310): Store=68a671ac00030280ed3c9b59840a157c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,718 INFO [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 68a671ac00030280ed3c9b59840a157c 2023-07-11 18:05:11,719 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cfeeac3165a77206892059eaf409a93a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,719 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711719"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711719"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711719"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711719"}]},"ts":"1689098711719"} 2023-07-11 18:05:11,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:05:11,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:05:11,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:05:11,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34ae1cb300031e6413911b11bb3c0613, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613.', STARTKEY => 'eee', ENDKEY => 'fff'} 2023-07-11 18:05:11,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:05:11,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:05:11,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:05:11,725 DEBUG [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/colfamily31 2023-07-11 18:05:11,726 DEBUG [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/colfamily31 2023-07-11 18:05:11,726 INFO [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68a671ac00030280ed3c9b59840a157c columnFamilyName colfamily31 2023-07-11 18:05:11,727 INFO [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:05:11,727 INFO [StoreOpener-68a671ac00030280ed3c9b59840a157c-1] regionserver.HStore(310): Store=68a671ac00030280ed3c9b59840a157c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,728 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:05:11,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c 2023-07-11 18:05:11,731 DEBUG [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/colfamily11 2023-07-11 18:05:11,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c 2023-07-11 18:05:11,731 DEBUG [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/colfamily11 2023-07-11 18:05:11,732 INFO [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a49a7d0f0c324e9e04b887b069379ae columnFamilyName colfamily11 2023-07-11 18:05:11,733 INFO [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] regionserver.HStore(310): Store=3a49a7d0f0c324e9e04b887b069379ae/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,734 INFO [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:05:11,734 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily11 2023-07-11 18:05:11,734 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily11 2023-07-11 18:05:11,735 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34ae1cb300031e6413911b11bb3c0613 columnFamilyName colfamily11 2023-07-11 18:05:11,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,737 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(310): Store=34ae1cb300031e6413911b11bb3c0613/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,737 DEBUG [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/colfamily21 2023-07-11 18:05:11,737 DEBUG [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/colfamily21 2023-07-11 18:05:11,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=11 2023-07-11 18:05:11,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 68a671ac00030280ed3c9b59840a157c 2023-07-11 18:05:11,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=11, state=SUCCESS; OpenRegionProcedure cfeeac3165a77206892059eaf409a93a, server=jenkins-hbase9.apache.org,36619,1689098707062 in 487 msec 2023-07-11 18:05:11,738 INFO [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a49a7d0f0c324e9e04b887b069379ae columnFamilyName colfamily21 2023-07-11 18:05:11,738 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:05:11,739 INFO [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] regionserver.HStore(310): Store=3a49a7d0f0c324e9e04b887b069379ae/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,739 INFO [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:05:11,742 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily21 2023-07-11 18:05:11,742 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily21 2023-07-11 18:05:11,742 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cfeeac3165a77206892059eaf409a93a, ASSIGN in 760 msec 2023-07-11 18:05:11,742 DEBUG [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/colfamily31 2023-07-11 18:05:11,742 DEBUG [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/colfamily31 2023-07-11 18:05:11,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,743 INFO [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a49a7d0f0c324e9e04b887b069379ae columnFamilyName colfamily31 2023-07-11 18:05:11,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 68a671ac00030280ed3c9b59840a157c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65673062, jitterRate=-0.021395117044448853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 68a671ac00030280ed3c9b59840a157c: 2023-07-11 18:05:11,744 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e6114557edd3e2be4679297c99dbb707, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,744 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689098711743"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711743"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711743"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711743"}]},"ts":"1689098711743"} 2023-07-11 18:05:11,744 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34ae1cb300031e6413911b11bb3c0613 columnFamilyName colfamily21 2023-07-11 18:05:11,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c., pid=54, masterSystemTime=1689098711413 2023-07-11 18:05:11,745 INFO [StoreOpener-3a49a7d0f0c324e9e04b887b069379ae-1] regionserver.HStore(310): Store=3a49a7d0f0c324e9e04b887b069379ae/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,747 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(310): Store=34ae1cb300031e6413911b11bb3c0613/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,747 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:05:11,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:05:11,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:05:11,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:05:11,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:05:11,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:05:11,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 697385c0414f8f3b285f33f1ce166651, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2023-07-11 18:05:11,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 697385c0414f8f3b285f33f1ce166651 2023-07-11 18:05:11,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 697385c0414f8f3b285f33f1ce166651 2023-07-11 18:05:11,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 697385c0414f8f3b285f33f1ce166651 2023-07-11 18:05:11,750 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily31 2023-07-11 18:05:11,750 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily31 2023-07-11 18:05:11,751 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34ae1cb300031e6413911b11bb3c0613 columnFamilyName colfamily31 2023-07-11 18:05:11,753 INFO [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 697385c0414f8f3b285f33f1ce166651 2023-07-11 18:05:11,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=10 2023-07-11 18:05:11,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=10, state=SUCCESS; OpenRegionProcedure e6114557edd3e2be4679297c99dbb707, server=jenkins-hbase9.apache.org,38785,1689098706958 in 553 msec 2023-07-11 18:05:11,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,753 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(310): Store=34ae1cb300031e6413911b11bb3c0613/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:05:11,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:05:11,757 DEBUG [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/colfamily11 2023-07-11 18:05:11,757 DEBUG [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/colfamily11 2023-07-11 18:05:11,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6114557edd3e2be4679297c99dbb707, ASSIGN in 775 msec 2023-07-11 18:05:11,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:05:11,758 INFO [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 697385c0414f8f3b285f33f1ce166651 columnFamilyName colfamily11 2023-07-11 18:05:11,759 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=68a671ac00030280ed3c9b59840a157c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,759 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711759"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711759"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711759"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711759"}]},"ts":"1689098711759"} 2023-07-11 18:05:11,759 INFO [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] regionserver.HStore(310): Store=697385c0414f8f3b285f33f1ce166651/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,759 INFO [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 697385c0414f8f3b285f33f1ce166651 2023-07-11 18:05:11,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3a49a7d0f0c324e9e04b887b069379ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64592258, jitterRate=-0.037500351667404175}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3a49a7d0f0c324e9e04b887b069379ae: 2023-07-11 18:05:11,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae., pid=46, masterSystemTime=1689098711361 2023-07-11 18:05:11,764 DEBUG [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/colfamily21 2023-07-11 18:05:11,764 DEBUG [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/colfamily21 2023-07-11 18:05:11,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:05:11,764 INFO [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 697385c0414f8f3b285f33f1ce166651 columnFamilyName colfamily21 2023-07-11 18:05:11,766 INFO [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] regionserver.HStore(310): Store=697385c0414f8f3b285f33f1ce166651/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,766 INFO [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 697385c0414f8f3b285f33f1ce166651 2023-07-11 18:05:11,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:05:11,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:05:11,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:05:11,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a535c854541161846ee0519898cadf3f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2023-07-11 18:05:11,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true a535c854541161846ee0519898cadf3f 2023-07-11 18:05:11,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a535c854541161846ee0519898cadf3f 2023-07-11 18:05:11,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a535c854541161846ee0519898cadf3f 2023-07-11 18:05:11,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=12 2023-07-11 18:05:11,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=12, state=SUCCESS; OpenRegionProcedure 68a671ac00030280ed3c9b59840a157c, server=jenkins-hbase9.apache.org,33801,1689098707010 in 497 msec 2023-07-11 18:05:11,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,770 DEBUG [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/colfamily31 2023-07-11 18:05:11,770 DEBUG [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/colfamily31 2023-07-11 18:05:11,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 34ae1cb300031e6413911b11bb3c0613; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74381773, jitterRate=0.10837478935718536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,771 INFO [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 697385c0414f8f3b285f33f1ce166651 columnFamilyName colfamily31 2023-07-11 18:05:11,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 34ae1cb300031e6413911b11bb3c0613: 2023-07-11 18:05:11,771 INFO [StoreOpener-697385c0414f8f3b285f33f1ce166651-1] regionserver.HStore(310): Store=697385c0414f8f3b285f33f1ce166651/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651 2023-07-11 18:05:11,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613., pid=43, masterSystemTime=1689098711307 2023-07-11 18:05:11,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651 2023-07-11 18:05:11,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=68a671ac00030280ed3c9b59840a157c, ASSIGN in 792 msec 2023-07-11 18:05:11,776 INFO [StoreOpener-a535c854541161846ee0519898cadf3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region a535c854541161846ee0519898cadf3f 2023-07-11 18:05:11,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:05:11,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:05:11,778 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=34ae1cb300031e6413911b11bb3c0613, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:11,778 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711778"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711778"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711778"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711778"}]},"ts":"1689098711778"} 2023-07-11 18:05:11,779 DEBUG [StoreOpener-a535c854541161846ee0519898cadf3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/colfamily11 2023-07-11 18:05:11,779 DEBUG [StoreOpener-a535c854541161846ee0519898cadf3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/colfamily11 2023-07-11 18:05:11,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,779 INFO [StoreOpener-a535c854541161846ee0519898cadf3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a535c854541161846ee0519898cadf3f columnFamilyName colfamily11 2023-07-11 18:05:11,781 INFO [StoreOpener-a535c854541161846ee0519898cadf3f-1] regionserver.HStore(310): Store=a535c854541161846ee0519898cadf3f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 697385c0414f8f3b285f33f1ce166651 2023-07-11 18:05:11,781 INFO [StoreOpener-a535c854541161846ee0519898cadf3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region a535c854541161846ee0519898cadf3f 2023-07-11 18:05:11,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 697385c0414f8f3b285f33f1ce166651; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72911672, jitterRate=0.08646857738494873}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 697385c0414f8f3b285f33f1ce166651: 2023-07-11 18:05:11,785 DEBUG [StoreOpener-a535c854541161846ee0519898cadf3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/colfamily21 2023-07-11 18:05:11,786 DEBUG [StoreOpener-a535c854541161846ee0519898cadf3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/colfamily21 2023-07-11 18:05:11,786 INFO [StoreOpener-a535c854541161846ee0519898cadf3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a535c854541161846ee0519898cadf3f columnFamilyName colfamily21 2023-07-11 18:05:11,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651., pid=55, masterSystemTime=1689098711413 2023-07-11 18:05:11,789 INFO [StoreOpener-a535c854541161846ee0519898cadf3f-1] regionserver.HStore(310): Store=a535c854541161846ee0519898cadf3f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,790 INFO [StoreOpener-a535c854541161846ee0519898cadf3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region a535c854541161846ee0519898cadf3f 2023-07-11 18:05:11,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:05:11,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:05:11,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:05:11,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9dd9757b1ce8f958386c6599a273f3ee, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee.', STARTKEY => 'yyy', ENDKEY => 'zzz'} 2023-07-11 18:05:11,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:05:11,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:05:11,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:05:11,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=14 2023-07-11 18:05:11,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=14, state=SUCCESS; OpenRegionProcedure 34ae1cb300031e6413911b11bb3c0613, server=jenkins-hbase9.apache.org,38785,1689098706958 in 587 msec 2023-07-11 18:05:11,793 DEBUG [StoreOpener-a535c854541161846ee0519898cadf3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/colfamily31 2023-07-11 18:05:11,793 DEBUG [StoreOpener-a535c854541161846ee0519898cadf3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/colfamily31 2023-07-11 18:05:11,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34ae1cb300031e6413911b11bb3c0613, ASSIGN in 813 msec 2023-07-11 18:05:11,793 INFO [StoreOpener-a535c854541161846ee0519898cadf3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a535c854541161846ee0519898cadf3f columnFamilyName colfamily31 2023-07-11 18:05:11,794 INFO [StoreOpener-a535c854541161846ee0519898cadf3f-1] regionserver.HStore(310): Store=a535c854541161846ee0519898cadf3f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,794 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=697385c0414f8f3b285f33f1ce166651, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,794 INFO [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:05:11,797 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711794"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711794"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711794"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711794"}]},"ts":"1689098711794"} 2023-07-11 18:05:11,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f 2023-07-11 18:05:11,801 DEBUG [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/colfamily11 2023-07-11 18:05:11,801 DEBUG [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/colfamily11 2023-07-11 18:05:11,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f 2023-07-11 18:05:11,802 INFO [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dd9757b1ce8f958386c6599a273f3ee columnFamilyName colfamily11 2023-07-11 18:05:11,803 INFO [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] regionserver.HStore(310): Store=9dd9757b1ce8f958386c6599a273f3ee/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,804 INFO [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:05:11,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=25 2023-07-11 18:05:11,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=25, state=SUCCESS; OpenRegionProcedure 697385c0414f8f3b285f33f1ce166651, server=jenkins-hbase9.apache.org,33801,1689098707010 in 527 msec 2023-07-11 18:05:11,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,811 DEBUG [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/colfamily21 2023-07-11 18:05:11,811 DEBUG [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/colfamily21 2023-07-11 18:05:11,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=697385c0414f8f3b285f33f1ce166651, ASSIGN in 829 msec 2023-07-11 18:05:11,812 INFO [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dd9757b1ce8f958386c6599a273f3ee columnFamilyName colfamily21 2023-07-11 18:05:11,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a535c854541161846ee0519898cadf3f 2023-07-11 18:05:11,812 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=3a49a7d0f0c324e9e04b887b069379ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,812 INFO [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] regionserver.HStore(310): Store=9dd9757b1ce8f958386c6599a273f3ee/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,813 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711812"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711812"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711812"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711812"}]},"ts":"1689098711812"} 2023-07-11 18:05:11,813 INFO [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:05:11,815 DEBUG [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/colfamily31 2023-07-11 18:05:11,815 DEBUG [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/colfamily31 2023-07-11 18:05:11,816 INFO [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dd9757b1ce8f958386c6599a273f3ee columnFamilyName colfamily31 2023-07-11 18:05:11,816 INFO [StoreOpener-9dd9757b1ce8f958386c6599a273f3ee-1] regionserver.HStore(310): Store=9dd9757b1ce8f958386c6599a273f3ee/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:05:11,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:05:11,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a535c854541161846ee0519898cadf3f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65389534, jitterRate=-0.02562001347541809}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a535c854541161846ee0519898cadf3f: 2023-07-11 18:05:11,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=26 2023-07-11 18:05:11,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=26, state=SUCCESS; OpenRegionProcedure 3a49a7d0f0c324e9e04b887b069379ae, server=jenkins-hbase9.apache.org,36619,1689098707062 in 595 msec 2023-07-11 18:05:11,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f., pid=45, masterSystemTime=1689098711361 2023-07-11 18:05:11,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=3a49a7d0f0c324e9e04b887b069379ae, ASSIGN in 841 msec 2023-07-11 18:05:11,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:05:11,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:05:11,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:05:11,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc5337c98b33958209dee082b9968414, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2023-07-11 18:05:11,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true cc5337c98b33958209dee082b9968414 2023-07-11 18:05:11,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for cc5337c98b33958209dee082b9968414 2023-07-11 18:05:11,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for cc5337c98b33958209dee082b9968414 2023-07-11 18:05:11,824 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a535c854541161846ee0519898cadf3f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,824 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711824"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711824"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711824"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711824"}]},"ts":"1689098711824"} 2023-07-11 18:05:11,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:05:11,829 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=15 2023-07-11 18:05:11,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=15, state=SUCCESS; OpenRegionProcedure a535c854541161846ee0519898cadf3f, server=jenkins-hbase9.apache.org,36619,1689098707062 in 612 msec 2023-07-11 18:05:11,830 INFO [StoreOpener-cc5337c98b33958209dee082b9968414-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region cc5337c98b33958209dee082b9968414 2023-07-11 18:05:11,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a535c854541161846ee0519898cadf3f, ASSIGN in 852 msec 2023-07-11 18:05:11,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9dd9757b1ce8f958386c6599a273f3ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59271283, jitterRate=-0.11678905785083771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9dd9757b1ce8f958386c6599a273f3ee: 2023-07-11 18:05:11,833 DEBUG [StoreOpener-cc5337c98b33958209dee082b9968414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/colfamily11 2023-07-11 18:05:11,833 DEBUG [StoreOpener-cc5337c98b33958209dee082b9968414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/colfamily11 2023-07-11 18:05:11,834 INFO [StoreOpener-cc5337c98b33958209dee082b9968414-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc5337c98b33958209dee082b9968414 columnFamilyName colfamily11 2023-07-11 18:05:11,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee., pid=58, masterSystemTime=1689098711413 2023-07-11 18:05:11,836 INFO [StoreOpener-cc5337c98b33958209dee082b9968414-1] regionserver.HStore(310): Store=cc5337c98b33958209dee082b9968414/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,836 INFO [StoreOpener-cc5337c98b33958209dee082b9968414-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region cc5337c98b33958209dee082b9968414 2023-07-11 18:05:11,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:05:11,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:05:11,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:05:11,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e821bd6d21478c1aef93851d0f84803, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803.', STARTKEY => 'ggg', ENDKEY => 'hhh'} 2023-07-11 18:05:11,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:05:11,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,838 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=9dd9757b1ce8f958386c6599a273f3ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:05:11,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:05:11,838 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711838"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711838"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711838"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711838"}]},"ts":"1689098711838"} 2023-07-11 18:05:11,839 DEBUG [StoreOpener-cc5337c98b33958209dee082b9968414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/colfamily21 2023-07-11 18:05:11,839 DEBUG [StoreOpener-cc5337c98b33958209dee082b9968414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/colfamily21 2023-07-11 18:05:11,840 INFO [StoreOpener-cc5337c98b33958209dee082b9968414-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc5337c98b33958209dee082b9968414 columnFamilyName colfamily21 2023-07-11 18:05:11,841 INFO [StoreOpener-cc5337c98b33958209dee082b9968414-1] regionserver.HStore(310): Store=cc5337c98b33958209dee082b9968414/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,841 INFO [StoreOpener-cc5337c98b33958209dee082b9968414-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region cc5337c98b33958209dee082b9968414 2023-07-11 18:05:11,844 DEBUG [StoreOpener-cc5337c98b33958209dee082b9968414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/colfamily31 2023-07-11 18:05:11,844 DEBUG [StoreOpener-cc5337c98b33958209dee082b9968414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/colfamily31 2023-07-11 18:05:11,844 INFO [StoreOpener-cc5337c98b33958209dee082b9968414-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc5337c98b33958209dee082b9968414 columnFamilyName colfamily31 2023-07-11 18:05:11,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=34 2023-07-11 18:05:11,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=34, state=SUCCESS; OpenRegionProcedure 9dd9757b1ce8f958386c6599a273f3ee, server=jenkins-hbase9.apache.org,33801,1689098707010 in 552 msec 2023-07-11 18:05:11,845 INFO [StoreOpener-cc5337c98b33958209dee082b9968414-1] regionserver.HStore(310): Store=cc5337c98b33958209dee082b9968414/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414 2023-07-11 18:05:11,846 INFO [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:05:11,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9dd9757b1ce8f958386c6599a273f3ee, ASSIGN in 865 msec 2023-07-11 18:05:11,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414 2023-07-11 18:05:11,850 DEBUG [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/colfamily11 2023-07-11 18:05:11,850 DEBUG [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/colfamily11 2023-07-11 18:05:11,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,851 INFO [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e821bd6d21478c1aef93851d0f84803 columnFamilyName colfamily11 2023-07-11 18:05:11,852 INFO [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] regionserver.HStore(310): Store=1e821bd6d21478c1aef93851d0f84803/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,852 INFO [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:05:11,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for cc5337c98b33958209dee082b9968414 2023-07-11 18:05:11,854 DEBUG [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/colfamily21 2023-07-11 18:05:11,855 DEBUG [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/colfamily21 2023-07-11 18:05:11,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,855 INFO [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e821bd6d21478c1aef93851d0f84803 columnFamilyName colfamily21 2023-07-11 18:05:11,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened cc5337c98b33958209dee082b9968414; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70851365, jitterRate=0.05576761066913605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for cc5337c98b33958209dee082b9968414: 2023-07-11 18:05:11,856 INFO [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] regionserver.HStore(310): Store=1e821bd6d21478c1aef93851d0f84803/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,856 INFO [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:05:11,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414., pid=52, masterSystemTime=1689098711361 2023-07-11 18:05:11,859 DEBUG [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/colfamily31 2023-07-11 18:05:11,859 DEBUG [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/colfamily31 2023-07-11 18:05:11,859 INFO [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e821bd6d21478c1aef93851d0f84803 columnFamilyName colfamily31 2023-07-11 18:05:11,860 INFO [StoreOpener-1e821bd6d21478c1aef93851d0f84803-1] regionserver.HStore(310): Store=1e821bd6d21478c1aef93851d0f84803/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:05:11,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:05:11,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:05:11,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:05:11,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:05:11,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01c403825db7c339c13e2f1101543b42, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42.', STARTKEY => 'lll', ENDKEY => 'mmm'} 2023-07-11 18:05:11,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 01c403825db7c339c13e2f1101543b42 2023-07-11 18:05:11,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 01c403825db7c339c13e2f1101543b42 2023-07-11 18:05:11,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 01c403825db7c339c13e2f1101543b42 2023-07-11 18:05:11,864 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cc5337c98b33958209dee082b9968414, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,864 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711864"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711864"}]},"ts":"1689098711864"} 2023-07-11 18:05:11,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:05:11,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=29 2023-07-11 18:05:11,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=29, state=SUCCESS; OpenRegionProcedure cc5337c98b33958209dee082b9968414, server=jenkins-hbase9.apache.org,36619,1689098707062 in 614 msec 2023-07-11 18:05:11,874 INFO [StoreOpener-01c403825db7c339c13e2f1101543b42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 01c403825db7c339c13e2f1101543b42 2023-07-11 18:05:11,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=cc5337c98b33958209dee082b9968414, ASSIGN in 892 msec 2023-07-11 18:05:11,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1e821bd6d21478c1aef93851d0f84803; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61984173, jitterRate=-0.07636384665966034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1e821bd6d21478c1aef93851d0f84803: 2023-07-11 18:05:11,877 DEBUG [StoreOpener-01c403825db7c339c13e2f1101543b42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/colfamily11 2023-07-11 18:05:11,878 DEBUG [StoreOpener-01c403825db7c339c13e2f1101543b42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/colfamily11 2023-07-11 18:05:11,878 INFO [StoreOpener-01c403825db7c339c13e2f1101543b42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01c403825db7c339c13e2f1101543b42 columnFamilyName colfamily11 2023-07-11 18:05:11,879 INFO [StoreOpener-01c403825db7c339c13e2f1101543b42-1] regionserver.HStore(310): Store=01c403825db7c339c13e2f1101543b42/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,879 INFO [StoreOpener-01c403825db7c339c13e2f1101543b42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 01c403825db7c339c13e2f1101543b42 2023-07-11 18:05:11,881 DEBUG [StoreOpener-01c403825db7c339c13e2f1101543b42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/colfamily21 2023-07-11 18:05:11,881 DEBUG [StoreOpener-01c403825db7c339c13e2f1101543b42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/colfamily21 2023-07-11 18:05:11,881 INFO [StoreOpener-01c403825db7c339c13e2f1101543b42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01c403825db7c339c13e2f1101543b42 columnFamilyName colfamily21 2023-07-11 18:05:11,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803., pid=61, masterSystemTime=1689098711413 2023-07-11 18:05:11,882 INFO [StoreOpener-01c403825db7c339c13e2f1101543b42-1] regionserver.HStore(310): Store=01c403825db7c339c13e2f1101543b42/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,882 INFO [StoreOpener-01c403825db7c339c13e2f1101543b42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 01c403825db7c339c13e2f1101543b42 2023-07-11 18:05:11,884 DEBUG [StoreOpener-01c403825db7c339c13e2f1101543b42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/colfamily31 2023-07-11 18:05:11,884 DEBUG [StoreOpener-01c403825db7c339c13e2f1101543b42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/colfamily31 2023-07-11 18:05:11,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:05:11,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:05:11,885 INFO [StoreOpener-01c403825db7c339c13e2f1101543b42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01c403825db7c339c13e2f1101543b42 columnFamilyName colfamily31 2023-07-11 18:05:11,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:05:11,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c07a104cc172022c4212e2e7a10199ba, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2023-07-11 18:05:11,885 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1e821bd6d21478c1aef93851d0f84803, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,885 INFO [StoreOpener-01c403825db7c339c13e2f1101543b42-1] regionserver.HStore(310): Store=01c403825db7c339c13e2f1101543b42/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:05:11,886 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711885"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711885"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711885"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711885"}]},"ts":"1689098711885"} 2023-07-11 18:05:11,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:05:11,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:05:11,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:05:11,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42 2023-07-11 18:05:11,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42 2023-07-11 18:05:11,888 INFO [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:05:11,890 DEBUG [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/colfamily11 2023-07-11 18:05:11,890 DEBUG [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/colfamily11 2023-07-11 18:05:11,890 INFO [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c07a104cc172022c4212e2e7a10199ba columnFamilyName colfamily11 2023-07-11 18:05:11,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=16 2023-07-11 18:05:11,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=16, state=SUCCESS; OpenRegionProcedure 1e821bd6d21478c1aef93851d0f84803, server=jenkins-hbase9.apache.org,33801,1689098707010 in 578 msec 2023-07-11 18:05:11,891 INFO [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] regionserver.HStore(310): Store=c07a104cc172022c4212e2e7a10199ba/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,891 INFO [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:05:11,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 01c403825db7c339c13e2f1101543b42 2023-07-11 18:05:11,893 DEBUG [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/colfamily21 2023-07-11 18:05:11,893 DEBUG [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/colfamily21 2023-07-11 18:05:11,893 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=1e821bd6d21478c1aef93851d0f84803, ASSIGN in 913 msec 2023-07-11 18:05:11,893 INFO [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c07a104cc172022c4212e2e7a10199ba columnFamilyName colfamily21 2023-07-11 18:05:11,894 INFO [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] regionserver.HStore(310): Store=c07a104cc172022c4212e2e7a10199ba/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,894 INFO [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:05:11,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,896 DEBUG [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/colfamily31 2023-07-11 18:05:11,896 DEBUG [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/colfamily31 2023-07-11 18:05:11,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 01c403825db7c339c13e2f1101543b42; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61670030, jitterRate=-0.08104494214057922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,896 INFO [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c07a104cc172022c4212e2e7a10199ba columnFamilyName colfamily31 2023-07-11 18:05:11,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 01c403825db7c339c13e2f1101543b42: 2023-07-11 18:05:11,897 INFO [StoreOpener-c07a104cc172022c4212e2e7a10199ba-1] regionserver.HStore(310): Store=c07a104cc172022c4212e2e7a10199ba/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:05:11,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42., pid=49, masterSystemTime=1689098711361 2023-07-11 18:05:11,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:05:11,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:05:11,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:05:11,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:05:11,900 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=01c403825db7c339c13e2f1101543b42, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:11,901 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711900"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711900"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711900"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711900"}]},"ts":"1689098711900"} 2023-07-11 18:05:11,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:05:11,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:05:11,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=21 2023-07-11 18:05:11,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=21, state=SUCCESS; OpenRegionProcedure 01c403825db7c339c13e2f1101543b42, server=jenkins-hbase9.apache.org,36619,1689098707062 in 666 msec 2023-07-11 18:05:11,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:05:11,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c07a104cc172022c4212e2e7a10199ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63914418, jitterRate=-0.04760095477104187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:05:11,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c07a104cc172022c4212e2e7a10199ba: 2023-07-11 18:05:11,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba., pid=59, masterSystemTime=1689098711413 2023-07-11 18:05:11,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=01c403825db7c339c13e2f1101543b42, ASSIGN in 927 msec 2023-07-11 18:05:11,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:05:11,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:05:11,923 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=c07a104cc172022c4212e2e7a10199ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:11,923 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098711923"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098711923"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098711923"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098711923"}]},"ts":"1689098711923"} 2023-07-11 18:05:11,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=22 2023-07-11 18:05:11,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=22, state=SUCCESS; OpenRegionProcedure c07a104cc172022c4212e2e7a10199ba, server=jenkins-hbase9.apache.org,33801,1689098707010 in 627 msec 2023-07-11 18:05:11,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=9 2023-07-11 18:05:11,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c07a104cc172022c4212e2e7a10199ba, ASSIGN in 950 msec 2023-07-11 18:05:11,935 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:05:11,935 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098711935"}]},"ts":"1689098711935"} 2023-07-11 18:05:11,938 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLED in hbase:meta 2023-07-11 18:05:11,941 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:05:11,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true in 1.8260 sec 2023-07-11 18:05:12,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 18:05:12,290 INFO [Listener at localhost/46025] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, procId: 9 completed 2023-07-11 18:05:12,290 DEBUG [Listener at localhost/46025] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true get assigned. Timeout = 60000ms 2023-07-11 18:05:12,292 INFO [Listener at localhost/46025] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:05:12,298 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38785] regionserver.StoreScanner(1093): Switch to stream read (scanned=32940 bytes) of info 2023-07-11 18:05:12,312 INFO [Listener at localhost/46025] hbase.HBaseTestingUtility(3484): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned to meta. Checking AM states. 2023-07-11 18:05:12,313 INFO [Listener at localhost/46025] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:05:12,314 INFO [Listener at localhost/46025] hbase.HBaseTestingUtility(3504): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned. 2023-07-11 18:05:12,463 DEBUG [hconnection-0x2e8c0f62-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:05:12,465 DEBUG [hconnection-0x2e8c0f62-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:05:12,503 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:05:12,516 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:05:12,522 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38785] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 5624 Client: jenkins//172.31.2.10 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:05:12,534 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33801] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6327 Client: jenkins//172.31.2.10 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:05:12,535 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36619] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 5625 Client: jenkins//172.31.2.10 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:05:12,727 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 18:05:12,737 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 18:05:12,743 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 18:05:12,748 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 18:05:12,753 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 18:05:12,757 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 18:05:12,761 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 18:05:12,766 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 18:05:12,770 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 18:05:12,774 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 18:05:12,778 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 18:05:12,783 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 18:05:12,787 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 18:05:12,791 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 18:05:12,796 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 18:05:12,801 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 18:05:12,804 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 18:05:12,809 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 18:05:12,814 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 18:05:12,818 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 18:05:12,821 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 18:05:12,826 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 18:05:12,830 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 18:05:12,833 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 18:05:12,837 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 18:05:12,847 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 18:05:12,852 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 18:05:12,857 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 18:05:12,862 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 18:05:12,867 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 18:05:12,872 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 18:05:12,877 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 18:05:12,882 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 18:05:12,886 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 18:05:12,891 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 18:05:12,896 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 18:05:12,899 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 18:05:12,904 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 18:05:12,908 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 18:05:12,912 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 18:05:12,917 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 18:05:12,921 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 18:05:12,924 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 18:05:12,928 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 18:05:12,932 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 18:05:12,935 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 18:05:12,939 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 18:05:12,942 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 18:05:12,945 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 18:05:12,949 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 18:05:13,216 WARN [Listener at localhost/46025] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: true 2023-07-11 18:05:13,217 INFO [Listener at localhost/46025] assignment.AssignmentTestingUtil(82): KILL REGION SERVER jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:13,217 INFO [Listener at localhost/46025] hbase.MiniHBaseCluster(271): Killing jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:13,220 ERROR [Listener at localhost/46025] helpers.MarkerIgnoringBase(143): ***** ABORTING region server jenkins-hbase9.apache.org,38785,1689098706958: Simulated kill ***** 2023-07-11 18:05:13,221 ERROR [Listener at localhost/46025] helpers.MarkerIgnoringBase(143): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2023-07-11 18:05:13,224 DEBUG [Listener at localhost/46025] util.JSONBean(130): Listing beans for java.lang:type=Memory 2023-07-11 18:05:13,227 DEBUG [Listener at localhost/46025] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=IPC 2023-07-11 18:05:13,228 DEBUG [Listener at localhost/46025] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Replication 2023-07-11 18:05:13,229 DEBUG [Listener at localhost/46025] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Server 2023-07-11 18:05:13,230 INFO [Listener at localhost/46025] regionserver.HRegionServer(2557): Dump of metrics as JSON on abort: { "beans": [ { "name": "java.lang:type=Memory", "modelerType": "sun.management.MemoryImpl", "Verbose": false, "ObjectPendingFinalizationCount": 0, "HeapMemoryUsage": { "committed": 986185728, "init": 513802240, "max": 2051014656, "used": 432387944 }, "NonHeapMemoryUsage": { "committed": 127664128, "init": 2555904, "max": -1, "used": 125254656 }, "ObjectName": "java.lang:type=Memory" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=IPC", "modelerType": "RegionServer,sub=IPC", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase9.apache.org" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Replication", "modelerType": "RegionServer,sub=Replication", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase9.apache.org" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Server", "modelerType": "RegionServer,sub=Server", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase9.apache.org" } ] } 2023-07-11 18:05:13,234 WARN [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35481] master.MasterRpcServices(612): jenkins-hbase9.apache.org,38785,1689098706958 reported a fatal error: ***** ABORTING region server jenkins-hbase9.apache.org,38785,1689098706958: Simulated kill ***** 2023-07-11 18:05:13,236 INFO [Listener at localhost/46025] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,38785,1689098706958' ***** 2023-07-11 18:05:13,236 INFO [Listener at localhost/46025] regionserver.HRegionServer(2311): STOPPED: Simulated kill 2023-07-11 18:05:13,236 INFO [RS:0;jenkins-hbase9:38785] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 18:05:13,237 INFO [Listener at localhost/46025] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:05:13,237 INFO [RS:0;jenkins-hbase9:38785] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager abruptly. 2023-07-11 18:05:13,237 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 18:05:13,237 INFO [RS:0;jenkins-hbase9:38785] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager abruptly. 2023-07-11 18:05:13,237 DEBUG [RS:0;jenkins-hbase9:38785] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a8349c7 to 127.0.0.1:56404 2023-07-11 18:05:13,238 DEBUG [RS:0;jenkins-hbase9:38785] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:05:13,255 DEBUG [RS:0;jenkins-hbase9:38785] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:05:13,256 INFO [RS:0;jenkins-hbase9:38785] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:05:13,257 INFO [RS:0;jenkins-hbase9:38785] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:38785 2023-07-11 18:05:13,267 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:13,267 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:05:13,267 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:05:13,267 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:13,267 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:05:13,267 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38785,1689098706958 2023-07-11 18:05:13,267 ERROR [Listener at localhost/46025-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b99cb9c rejected from java.util.concurrent.ThreadPoolExecutor@6fa64237[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 3] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-07-11 18:05:13,268 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:05:13,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:13,270 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,38785,1689098706958] 2023-07-11 18:05:13,270 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,38785,1689098706958; numProcessing=1 2023-07-11 18:05:13,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:13,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:13,271 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase9.apache.org,38785,1689098706958 znode expired, triggering replicatorRemoved event 2023-07-11 18:05:13,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:13,274 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,38785,1689098706958 already deleted, retry=false 2023-07-11 18:05:13,274 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase9.apache.org,38785,1689098706958 znode expired, triggering replicatorRemoved event 2023-07-11 18:05:13,274 INFO [RegionServerTracker-0] master.ServerManager(568): Processing expiration of jenkins-hbase9.apache.org,38785,1689098706958 on jenkins-hbase9.apache.org,35481,1689098705729 2023-07-11 18:05:13,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:13,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:05:13,278 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:05:13,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:13,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:05:13,284 DEBUG [RegionServerTracker-0] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:05:13,284 INFO [RegionServerTracker-0] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=62 for jenkins-hbase9.apache.org,38785,1689098706958 (carryingMeta=true) jenkins-hbase9.apache.org,38785,1689098706958/CRASHED/regionCount=10/lock=java.util.concurrent.locks.ReentrantReadWriteLock@1db38046[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-11 18:05:13,287 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:05:13,287 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 18:05:13,287 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:05:13,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:05:13,287 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 18:05:13,337 INFO [Listener at localhost/46025] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:05:13,340 INFO [Listener at localhost/46025] procedure.MasterProcedureTestingUtility(454): Restart 0 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:05:13,342 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 18:05:13,342 INFO [Listener at localhost/46025] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 18:05:13,342 INFO [Listener at localhost/46025] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:05:13,344 ERROR [Listener at localhost/46025] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-07-11 18:05:13,345 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 18:05:13,345 INFO [Listener at localhost/46025] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 18:05:13,345 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 18:05:13,345 INFO [Listener at localhost/46025] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:05:13,346 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 18:05:13,350 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[] 2023-07-11 18:05:13,352 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 18:05:13,352 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 18:05:13,353 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 18:05:13,353 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:05:13,354 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 18:05:13,355 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:05:13,355 DEBUG [Listener at localhost/46025] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 18:05:13,356 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 9 msec 2023-07-11 18:05:13,357 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 18:05:13,357 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,38785,1689098706958, table=hbase:meta, region=1588230740 2023-07-11 18:05:13,358 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689098743358 2023-07-11 18:05:13,358 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:05:13,359 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:05:13,360 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 18:05:13,361 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:13,361 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:05:13,362 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true, isMeta: true 2023-07-11 18:05:13,365 DEBUG [PEWorker-1] master.MasterWalManager(318): Renamed region directory: hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting 2023-07-11 18:05:13,367 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38785,1689098706958 WAL count=1, meta=true 2023-07-11 18:05:13,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta}] 2023-07-11 18:05:13,371 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 18:05:13,371 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:05:13,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:05:13,372 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 18:05:13,440 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:05:13,441 INFO [RS:0;jenkins-hbase9:38785] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,38785,1689098706958; zookeeper connection closed. 2023-07-11 18:05:13,441 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10155819b8c0001, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:05:13,442 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@661cf10f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@661cf10f 2023-07-11 18:05:13,467 DEBUG [hconnection-0x2b5ea280-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:05:13,588 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 18:05:13,589 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 18:05:13,670 DEBUG [hconnection-0x2b5ea280-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:05:13,975 DEBUG [hconnection-0x2b5ea280-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:05:14,478 DEBUG [hconnection-0x2b5ea280-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:05:14,486 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 18:05:14,559 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 18:05:14,560 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 18:05:14,561 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true' 2023-07-11 18:05:15,487 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:15,488 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:05:15,898 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 18:05:15,898 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 18:05:17,510 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:17,511 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:05:17,512 DEBUG [hconnection-0x2b5ea280-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4151 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:21,531 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:21,532 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:05:21,533 DEBUG [hconnection-0x2b5ea280-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8172 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:31,581 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:31,582 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:05:31,582 DEBUG [hconnection-0x2b5ea280-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18222 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:41,595 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:41,596 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:05:41,596 DEBUG [hconnection-0x2b5ea280-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28236 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:45,302 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase9.apache.org,38785,1689098706958 already deleted, retry=false 2023-07-11 18:05:51,602 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:05:51,603 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:05:51,604 DEBUG [hconnection-0x2b5ea280-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38243 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:00,682 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase9.apache.org,38785,1689098706958 already deleted, retry=false 2023-07-11 18:06:01,682 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:01,683 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:06:01,683 DEBUG [hconnection-0x2b5ea280-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48323 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:01,684 DEBUG [Listener at localhost/46025] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68518: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68518: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:01,685 WARN [Listener at localhost/46025] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-11T18:06:01.684Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68518: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68518: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:01,686 INFO [Listener at localhost/46025] procedure.MasterProcedureTestingUtility(454): Restart 1 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:06:01,686 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 18:06:01,686 INFO [Listener at localhost/46025] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 18:06:01,686 INFO [Listener at localhost/46025] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:06:01,686 ERROR [Listener at localhost/46025] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 18:06:01,686 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 18:06:01,686 INFO [Listener at localhost/46025] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 18:06:01,686 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 18:06:01,686 INFO [Listener at localhost/46025] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:06:01,689 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-11 18:06:01,690 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0] 2023-07-11 18:06:01,691 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 18:06:01,692 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 18:06:01,692 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 18:06:01,692 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:06:01,694 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 18:06:01,694 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:06:01,694 DEBUG [Listener at localhost/46025] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 18:06:01,695 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-11 18:06:01,695 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 18:06:01,696 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,38785,1689098706958, table=hbase:meta, region=1588230740 2023-07-11 18:06:01,696 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689098791696 2023-07-11 18:06:01,697 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:06:01,697 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true, isMeta: true 2023-07-11 18:06:01,699 DEBUG [hconnection-0x2b5ea280-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:06:01,701 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38785,1689098706958 WAL count=1, meta=true 2023-07-11 18:06:01,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta}] 2023-07-11 18:06:01,701 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 18:06:01,709 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:06:01,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=64, ppid=63, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:06:01,801 DEBUG [hconnection-0x2b5ea280-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:06:01,874 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36619] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=64 2023-07-11 18:06:01,898 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(300): Splitting hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, size=54.9 K (56255bytes) 2023-07-11 18:06:01,899 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta 2023-07-11 18:06:01,903 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta after 4ms 2023-07-11 18:06:01,911 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(311): Open hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta took 15ms 2023-07-11 18:06:01,926 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for 1588230740: last_flushed_sequence_id: 18446744073709551615 2023-07-11 18:06:01,935 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-2] util.CommonFSUtils$DfsBuilderUtility(753): Could not find replicate method on builder; will not set replicate when creating output stream java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DistributedFileSystem$HdfsDataOutputStreamBuilder.replicate() at java.lang.Class.getMethod(Class.java:1786) at org.apache.hadoop.hbase.util.CommonFSUtils$DfsBuilderUtility.(CommonFSUtils.java:750) at org.apache.hadoop.hbase.util.CommonFSUtils.createForWal(CommonFSUtils.java:802) at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter.initOutput(ProtobufLogWriter.java:102) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:78) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.createRecoveredEditsWriter(WALFactory.java:402) at org.apache.hadoop.hbase.wal.WALSplitter.createWriter(WALSplitter.java:516) at org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink.createRecoveredEditsWriter(AbstractRecoveredEditsOutputSink.java:69) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.getRecoveredEditsWriter(RecoveredEditsOutputSink.java:81) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.append(RecoveredEditsOutputSink.java:63) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.writeBuffer(OutputSink.java:249) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.doRun(OutputSink.java:241) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.run(OutputSink.java:211) 2023-07-11 18:06:01,937 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(400): Finishing writing output for hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta so closing down 2023-07-11 18:06:01,937 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-11 18:06:01,939 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta.temp 2023-07-11 18:06:01,942 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.OutputSink(146): 3 split writer threads finished 2023-07-11 18:06:01,965 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta.temp (wrote 60 edits, skipped 0 edits in 2 ms) 2023-07-11 18:06:01,967 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 18:06:01,967 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(423): Processed 61 edits across 1 Regions in 55 ms; skipped=1; WAL=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, size=54.9 K, length=56255, corrupted=false, cancelled=false 2023-07-11 18:06:01,967 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(426): Completed split of hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, journal: Splitting hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, size=54.9 K (56255bytes) at 1689098761898Finishing writing output for hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta so closing down at 1689098761937 (+39 ms)Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta.temp at 1689098761939 (+2 ms)3 split writer threads finished at 1689098761942 (+3 ms)Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta.temp (wrote 60 edits, skipped 0 edits in 2 ms) at 1689098761965 (+23 ms)Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 at 1689098761967 (+2 ms)Processed 61 edits across 1 Regions in 55 ms; skipped=1; WAL=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, size=54.9 K, length=56255, corrupted=false, cancelled=false at 1689098761967 2023-07-11 18:06:01,968 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta 2023-07-11 18:06:01,970 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=64 2023-07-11 18:06:01,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] master.HMaster(3641): Remote procedure done, pid=64 2023-07-11 18:06:01,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] wal.WALSplitUtil(141): Moved hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/oldWALs 2023-07-11 18:06:01,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=64, resume processing ppid=63 2023-07-11 18:06:01,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 in 269 msec 2023-07-11 18:06:01,982 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:06:01,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=62 2023-07-11 18:06:01,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 in 282 msec 2023-07-11 18:06:01,988 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting dir is empty, no logs to split. 2023-07-11 18:06:01,988 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38785,1689098706958 WAL count=0, meta=true 2023-07-11 18:06:01,988 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase9.apache.org,38785,1689098706958 WAL splitting is done? wals=0, meta=true 2023-07-11 18:06:01,988 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 18:06:01,988 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:06:01,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:06:01,988 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 18:06:02,002 DEBUG [hconnection-0x2b5ea280-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:06:02,305 DEBUG [hconnection-0x2b5ea280-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:06:02,808 DEBUG [hconnection-0x2b5ea280-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:06:03,815 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:03,816 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:06:05,821 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:05,823 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:06:05,823 DEBUG [hconnection-0x2b5ea280-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4124 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:09,840 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:09,841 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:06:09,841 DEBUG [hconnection-0x2b5ea280-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8142 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:19,885 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:19,886 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:06:19,886 DEBUG [hconnection-0x2b5ea280-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18187 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:29,939 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:29,940 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:06:29,941 DEBUG [hconnection-0x2b5ea280-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28241 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:39,970 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:39,971 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:06:39,971 DEBUG [hconnection-0x2b5ea280-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38272 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:50,028 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:50,029 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:06:50,029 DEBUG [hconnection-0x2b5ea280-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48330 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:50,030 DEBUG [Listener at localhost/46025] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68338: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68338: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:50,031 WARN [Listener at localhost/46025] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-11T18:06:50.031Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68338: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68338: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:50,032 INFO [Listener at localhost/46025] procedure.MasterProcedureTestingUtility(454): Restart 2 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:06:50,032 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 18:06:50,032 INFO [Listener at localhost/46025] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 18:06:50,032 INFO [Listener at localhost/46025] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:06:50,032 ERROR [Listener at localhost/46025] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 18:06:50,032 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 18:06:50,032 INFO [Listener at localhost/46025] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 18:06:50,032 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 18:06:50,032 INFO [Listener at localhost/46025] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:06:50,034 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-11 18:06:50,036 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1] 2023-07-11 18:06:50,036 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 18:06:50,036 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 18:06:50,037 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 18:06:50,037 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 18:06:50,037 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 18:06:50,038 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:06:50,039 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 18:06:50,039 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:06:50,040 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:06:50,040 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:06:50,040 DEBUG [Listener at localhost/46025] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 18:06:50,040 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:06:50,040 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:06:50,040 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-11 18:06:50,041 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 18:06:50,041 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,38785,1689098706958, table=hbase:meta, region=1588230740 2023-07-11 18:06:50,041 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689098840041 2023-07-11 18:06:50,042 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:06:50,044 DEBUG [hconnection-0x2b5ea280-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:06:50,045 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting dir is empty, no logs to split. 2023-07-11 18:06:50,045 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38785,1689098706958 WAL count=0, meta=true 2023-07-11 18:06:50,045 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase9.apache.org,38785,1689098706958 WAL splitting is done? wals=0, meta=true 2023-07-11 18:06:50,045 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 18:06:50,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 18:06:50,046 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 18:06:50,046 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:06:50,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:06:50,046 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 18:06:50,146 DEBUG [hconnection-0x2b5ea280-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:06:50,348 DEBUG [hconnection-0x2b5ea280-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:06:50,652 DEBUG [hconnection-0x2b5ea280-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:06:51,155 DEBUG [hconnection-0x2b5ea280-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:06:52,159 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:52,160 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:06:54,170 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:54,171 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:06:54,171 DEBUG [hconnection-0x2b5ea280-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4127 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:58,182 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:06:58,183 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:06:58,183 DEBUG [hconnection-0x2b5ea280-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8139 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:08,190 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:08,191 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:07:08,191 DEBUG [hconnection-0x2b5ea280-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18147 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:11,432 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-07-11 18:07:18,260 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:18,263 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:07:18,263 DEBUG [hconnection-0x2b5ea280-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28219 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:28,294 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:28,295 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:07:28,295 DEBUG [hconnection-0x2b5ea280-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38251 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:38,317 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:38,318 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:07:38,318 DEBUG [hconnection-0x2b5ea280-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48274 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:38,319 DEBUG [Listener at localhost/46025] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68414: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68414: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:38,320 WARN [Listener at localhost/46025] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-11T18:07:38.320Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68414: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68414: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38785,1689098706958, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38785 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:38,320 INFO [Listener at localhost/46025] procedure.MasterProcedureTestingUtility(454): Restart 3 exec state=pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:38,320 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 18:07:38,321 INFO [Listener at localhost/46025] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 18:07:38,321 INFO [Listener at localhost/46025] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:07:38,321 ERROR [Listener at localhost/46025] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 18:07:38,321 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 18:07:38,321 INFO [Listener at localhost/46025] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 18:07:38,321 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 18:07:38,321 INFO [Listener at localhost/46025] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:07:38,323 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 18:07:38,324 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7] 2023-07-11 18:07:38,324 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 18:07:38,325 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 18:07:38,325 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 18:07:38,325 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 18:07:38,326 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 18:07:38,326 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:07:38,328 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 18:07:38,328 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:38,328 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:38,328 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:38,328 DEBUG [Listener at localhost/46025] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 18:07:38,329 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:38,329 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:38,329 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-11 18:07:38,343 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 18:07:38,344 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,38785,1689098706958, table=hbase:meta, region=1588230740 2023-07-11 18:07:38,347 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689098888347 2023-07-11 18:07:38,348 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:07:38,348 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 18:07:38,349 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 18:07:38,358 DEBUG [hconnection-0x2b5ea280-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:07:38,358 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 18:07:38,359 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 18:07:38,460 DEBUG [hconnection-0x2b5ea280-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:07:38,509 DEBUG [jenkins-hbase9:35481] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-07-11 18:07:38,509 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:07:38,510 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:07:38,510 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:07:38,510 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:07:38,511 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,33801,1689098707010, state=OPENING 2023-07-11 18:07:38,512 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 18:07:38,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:07:38,513 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 18:07:38,663 WARN [ReadOnlyZKClient-127.0.0.1:56404@0x2619c11d] client.ZKConnectionRegistry(168): Meta region is in state OPENING 2023-07-11 18:07:38,664 DEBUG [hconnection-0x2b5ea280-shared-pool-8] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:07:38,666 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:07:38,667 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33801] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Scan size: 97 connection: 172.31.2.10:45632 deadline: 1689098918360, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:38,667 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 18:07:38,675 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 18:07:38,676 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:07:38,678 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33801%2C1689098707010.meta, suffix=.meta, logDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,33801,1689098707010, archiveDir=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/oldWALs, maxLogs=32 2023-07-11 18:07:38,700 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK] 2023-07-11 18:07:38,702 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK] 2023-07-11 18:07:38,704 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK] 2023-07-11 18:07:38,713 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,33801,1689098707010/jenkins-hbase9.apache.org%2C33801%2C1689098707010.meta.1689098858680.meta 2023-07-11 18:07:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41785,DS-4dc139e0-f1bc-4b90-84ad-19b5d16cabbe,DISK], DatanodeInfoWithStorage[127.0.0.1:39225,DS-e9d8e264-1deb-4f74-8b66-90c71c14742b,DISK], DatanodeInfoWithStorage[127.0.0.1:46059,DS-b9c5174f-b457-40ad-aaac-7080e57eaa67,DISK]] 2023-07-11 18:07:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:07:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 18:07:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 18:07:38,716 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 18:07:38,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 18:07:38,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:07:38,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 18:07:38,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 18:07:38,718 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 18:07:38,720 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/info 2023-07-11 18:07:38,720 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/info 2023-07-11 18:07:38,720 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 18:07:38,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:38,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 18:07:38,722 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/rep_barrier 2023-07-11 18:07:38,723 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/rep_barrier 2023-07-11 18:07:38,723 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 18:07:38,723 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:38,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 18:07:38,724 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/table 2023-07-11 18:07:38,724 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/table 2023-07-11 18:07:38,725 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 18:07:38,726 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:38,726 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740 2023-07-11 18:07:38,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740 2023-07-11 18:07:38,729 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 18:07:38,744 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 274, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=63, path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 18:07:38,745 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=51.43 KB heapSize=72.08 KB 2023-07-11 18:07:38,821 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=51.14 KB at sequenceid=63 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/.tmp/info/665e8279cfa7475e957225dedf689191 2023-07-11 18:07:38,874 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=296 B at sequenceid=63 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/.tmp/table/6806311c05884c539f04cc0bde131b77 2023-07-11 18:07:38,881 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/.tmp/info/665e8279cfa7475e957225dedf689191 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/info/665e8279cfa7475e957225dedf689191 2023-07-11 18:07:38,888 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/info/665e8279cfa7475e957225dedf689191, entries=270, sequenceid=63, filesize=57.3 K 2023-07-11 18:07:38,890 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/.tmp/table/6806311c05884c539f04cc0bde131b77 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/table/6806311c05884c539f04cc0bde131b77 2023-07-11 18:07:38,896 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/table/6806311c05884c539f04cc0bde131b77, entries=4, sequenceid=63, filesize=4.9 K 2023-07-11 18:07:38,896 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~51.43 KB/52664, heapSize ~71.80 KB/73520, currentSize=0 B/0 for 1588230740 in 151ms, sequenceid=63, compaction requested=false; wal=null 2023-07-11 18:07:38,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 18:07:38,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:07:38,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 18:07:38,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/63.seqid, newMaxSeqId=63, maxSeqId=1 2023-07-11 18:07:38,905 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=64; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60714256, jitterRate=-0.09528708457946777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:07:38,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 18:07:38,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=66, masterSystemTime=1689098858665 2023-07-11 18:07:38,910 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 18:07:38,910 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 18:07:38,910 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,33801,1689098707010, state=OPEN 2023-07-11 18:07:38,923 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 18:07:38,923 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 18:07:38,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-07-11 18:07:38,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010 in 410 msec 2023-07-11 18:07:38,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=65, resume processing ppid=62 2023-07-11 18:07:38,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 577 msec 2023-07-11 18:07:39,019 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca21663676d98522661b9a7b1a038300, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,020 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=e6114557edd3e2be4679297c99dbb707, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,020 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cfeeac3165a77206892059eaf409a93a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,020 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=68a671ac00030280ed3c9b59840a157c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,020 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66c52954a1e65ac4eea3ad65ab781210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,020 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=34ae1cb300031e6413911b11bb3c0613, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,021 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=a535c854541161846ee0519898cadf3f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,021 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1e821bd6d21478c1aef93851d0f84803, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,021 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=6fd79949daf97fb71187ed6ccb826c85, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,021 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca97340b0ab43753a8263ae334c5b475, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,021 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9d068f7fd612d2e21c191a1d38a29723, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,021 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c41300b446f1c31843a2ac322189ac5c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,022 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=01c403825db7c339c13e2f1101543b42, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,022 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c07a104cc172022c4212e2e7a10199ba, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,022 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1851532129addae5c0e78c4af9fe4b41, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,022 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9e32425e5b5ae93a85c8ed8a3e29ad2a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,022 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=697385c0414f8f3b285f33f1ce166651, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,023 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3a49a7d0f0c324e9e04b887b069379ae, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,023 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=12ffd9ba99aec19d05a9a4bdc190df5e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,023 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3fda35ffdbf54a7596d1f6e9dd4c3a45, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,023 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cc5337c98b33958209dee082b9968414, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,023 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=8360d53793b402665c7d088b5757078c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,023 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66f3e358060a5746d9b9f7c8e30affd1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,024 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=082ae0e1538d0ea4afa6018633714d86, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,024 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f4618a109b5b547019676f2a63009dd7, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,024 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9dd9757b1ce8f958386c6599a273f3ee, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,024 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f32630ccb5e2306ee100dad5b0bd664e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,024 INFO [Listener at localhost/46025] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 18:07:39,024 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689098919024 2023-07-11 18:07:39,024 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689098979024 2023-07-11 18:07:39,024 INFO [Listener at localhost/46025] assignment.AssignmentManager(1536): Joined the cluster in 676 msec 2023-07-11 18:07:39,025 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase9.apache.org,38785,1689098706958 had 10 regions 2023-07-11 18:07:39,025 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 18:07:39,025 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:39,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:07:39,025 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 18:07:39,275 INFO [Listener at localhost/46025] procedure.MasterProcedureTestingUtility(454): Restart 4 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:39,275 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 18:07:39,275 INFO [Listener at localhost/46025] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 18:07:39,275 INFO [Listener at localhost/46025] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:07:39,276 ERROR [Listener at localhost/46025] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 18:07:39,276 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 18:07:39,276 INFO [Listener at localhost/46025] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 18:07:39,276 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 18:07:39,276 INFO [Listener at localhost/46025] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:07:39,278 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 18:07:39,279 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14] 2023-07-11 18:07:39,279 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 18:07:39,279 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 18:07:39,279 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 18:07:39,279 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 18:07:39,279 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 18:07:39,280 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 18:07:39,280 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 18:07:39,280 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:07:39,281 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 18:07:39,283 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:39,283 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:39,283 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:39,283 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 18:07:39,283 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:39,283 DEBUG [Listener at localhost/46025] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 18:07:39,283 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:39,283 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:39,283 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:39,283 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:39,283 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-11 18:07:39,284 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 18:07:39,285 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,33801,1689098707010, table=hbase:meta, region=1588230740 2023-07-11 18:07:39,285 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689098889285 2023-07-11 18:07:39,286 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:07:39,293 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca21663676d98522661b9a7b1a038300, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,293 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=e6114557edd3e2be4679297c99dbb707, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,294 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cfeeac3165a77206892059eaf409a93a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,294 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=68a671ac00030280ed3c9b59840a157c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,294 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66c52954a1e65ac4eea3ad65ab781210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,294 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=34ae1cb300031e6413911b11bb3c0613, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,294 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=a535c854541161846ee0519898cadf3f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,294 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1e821bd6d21478c1aef93851d0f84803, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,295 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=6fd79949daf97fb71187ed6ccb826c85, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,295 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca97340b0ab43753a8263ae334c5b475, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,295 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9d068f7fd612d2e21c191a1d38a29723, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,295 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c41300b446f1c31843a2ac322189ac5c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,295 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=01c403825db7c339c13e2f1101543b42, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,295 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c07a104cc172022c4212e2e7a10199ba, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,295 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1851532129addae5c0e78c4af9fe4b41, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,296 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9e32425e5b5ae93a85c8ed8a3e29ad2a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,296 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=697385c0414f8f3b285f33f1ce166651, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,296 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3a49a7d0f0c324e9e04b887b069379ae, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,296 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=12ffd9ba99aec19d05a9a4bdc190df5e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,296 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3fda35ffdbf54a7596d1f6e9dd4c3a45, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,296 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cc5337c98b33958209dee082b9968414, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,296 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=8360d53793b402665c7d088b5757078c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,297 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66f3e358060a5746d9b9f7c8e30affd1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,297 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=082ae0e1538d0ea4afa6018633714d86, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,297 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f4618a109b5b547019676f2a63009dd7, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,297 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9dd9757b1ce8f958386c6599a273f3ee, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,297 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f32630ccb5e2306ee100dad5b0bd664e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,297 INFO [Listener at localhost/46025] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 18:07:39,297 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689098919297 2023-07-11 18:07:39,298 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689098979298 2023-07-11 18:07:39,298 INFO [Listener at localhost/46025] assignment.AssignmentManager(1536): Joined the cluster in 11 msec 2023-07-11 18:07:39,298 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase9.apache.org,38785,1689098706958 had 9 regions 2023-07-11 18:07:39,298 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 18:07:39,299 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true, isMeta: false 2023-07-11 18:07:39,301 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38785,1689098706958 WAL count=1, meta=false 2023-07-11 18:07:39,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736}] 2023-07-11 18:07:39,301 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 18:07:39,301 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:39,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:07:39,301 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 18:07:39,548 INFO [Listener at localhost/46025] procedure.MasterProcedureTestingUtility(454): Restart 5 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:39,548 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 18:07:39,548 INFO [Listener at localhost/46025] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 18:07:39,548 INFO [Listener at localhost/46025] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:07:39,548 ERROR [Listener at localhost/46025] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 18:07:39,549 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 18:07:39,549 INFO [Listener at localhost/46025] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 18:07:39,549 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 18:07:39,549 INFO [Listener at localhost/46025] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:07:39,550 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 18:07:39,551 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16] 2023-07-11 18:07:39,551 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 18:07:39,551 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 18:07:39,551 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 18:07:39,552 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 18:07:39,552 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 18:07:39,552 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 18:07:39,553 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 18:07:39,553 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:07:39,554 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 18:07:39,555 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:39,555 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:39,555 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:39,555 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 18:07:39,555 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:39,556 DEBUG [Listener at localhost/46025] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 18:07:39,556 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:39,556 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:39,556 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:39,556 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:39,556 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 6 msec 2023-07-11 18:07:39,557 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 18:07:39,558 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,33801,1689098707010, table=hbase:meta, region=1588230740 2023-07-11 18:07:39,558 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689098889558 2023-07-11 18:07:39,560 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:07:39,568 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca21663676d98522661b9a7b1a038300, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,568 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=e6114557edd3e2be4679297c99dbb707, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,569 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cfeeac3165a77206892059eaf409a93a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,569 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=68a671ac00030280ed3c9b59840a157c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,569 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66c52954a1e65ac4eea3ad65ab781210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,569 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=34ae1cb300031e6413911b11bb3c0613, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,570 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=a535c854541161846ee0519898cadf3f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,570 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1e821bd6d21478c1aef93851d0f84803, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,570 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=6fd79949daf97fb71187ed6ccb826c85, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,570 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca97340b0ab43753a8263ae334c5b475, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,571 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9d068f7fd612d2e21c191a1d38a29723, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,571 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c41300b446f1c31843a2ac322189ac5c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,571 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=01c403825db7c339c13e2f1101543b42, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,571 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c07a104cc172022c4212e2e7a10199ba, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,572 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1851532129addae5c0e78c4af9fe4b41, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,572 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9e32425e5b5ae93a85c8ed8a3e29ad2a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,572 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=697385c0414f8f3b285f33f1ce166651, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,572 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3a49a7d0f0c324e9e04b887b069379ae, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,573 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=12ffd9ba99aec19d05a9a4bdc190df5e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,573 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3fda35ffdbf54a7596d1f6e9dd4c3a45, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,573 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cc5337c98b33958209dee082b9968414, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,574 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=8360d53793b402665c7d088b5757078c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,574 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66f3e358060a5746d9b9f7c8e30affd1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,574 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=082ae0e1538d0ea4afa6018633714d86, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:39,574 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f4618a109b5b547019676f2a63009dd7, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,575 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9dd9757b1ce8f958386c6599a273f3ee, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:39,575 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f32630ccb5e2306ee100dad5b0bd664e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:39,575 INFO [Listener at localhost/46025] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 18:07:39,575 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689098919575 2023-07-11 18:07:39,575 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689098979575 2023-07-11 18:07:39,575 INFO [Listener at localhost/46025] assignment.AssignmentManager(1536): Joined the cluster in 15 msec 2023-07-11 18:07:39,576 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true, isMeta: false 2023-07-11 18:07:39,578 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38785,1689098706958 WAL count=1, meta=false 2023-07-11 18:07:39,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736}] 2023-07-11 18:07:39,578 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 18:07:39,580 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:39,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:07:39,734 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33801] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=68 2023-07-11 18:07:39,748 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(300): Splitting hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, size=291.3 K (298331bytes) 2023-07-11 18:07:39,748 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736 2023-07-11 18:07:39,749 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736 after 1ms 2023-07-11 18:07:39,754 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(311): Open hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736 took 6ms 2023-07-11 18:07:39,759 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for ca21663676d98522661b9a7b1a038300: last_flushed_sequence_id: 18446744073709551615 2023-07-11 18:07:39,762 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for 6fd79949daf97fb71187ed6ccb826c85: last_flushed_sequence_id: 18446744073709551615 2023-07-11 18:07:39,763 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for 9e32425e5b5ae93a85c8ed8a3e29ad2a: last_flushed_sequence_id: 18446744073709551615 2023-07-11 18:07:39,764 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp 2023-07-11 18:07:39,764 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for 8360d53793b402665c7d088b5757078c: last_flushed_sequence_id: 18446744073709551615 2023-07-11 18:07:39,766 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for 12ffd9ba99aec19d05a9a4bdc190df5e: last_flushed_sequence_id: 18446744073709551615 2023-07-11 18:07:39,771 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for c41300b446f1c31843a2ac322189ac5c: last_flushed_sequence_id: 18446744073709551615 2023-07-11 18:07:39,773 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for 082ae0e1538d0ea4afa6018633714d86: last_flushed_sequence_id: 18446744073709551615 2023-07-11 18:07:39,774 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for e6114557edd3e2be4679297c99dbb707: last_flushed_sequence_id: 18446744073709551615 2023-07-11 18:07:39,775 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for 34ae1cb300031e6413911b11bb3c0613: last_flushed_sequence_id: 18446744073709551615 2023-07-11 18:07:39,780 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp 2023-07-11 18:07:39,784 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp 2023-07-11 18:07:39,790 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp 2023-07-11 18:07:39,794 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(400): Finishing writing output for hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736 so closing down 2023-07-11 18:07:39,794 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-11 18:07:39,798 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp 2023-07-11 18:07:39,798 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp 2023-07-11 18:07:39,798 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp 2023-07-11 18:07:39,804 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp 2023-07-11 18:07:39,806 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp 2023-07-11 18:07:39,807 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.OutputSink(146): 3 split writer threads finished 2023-07-11 18:07:39,858 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-11 18:07:39,864 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/0000000000000000004 2023-07-11 18:07:39,865 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 2 ms) 2023-07-11 18:07:39,873 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/0000000000000000004 2023-07-11 18:07:39,879 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-11 18:07:39,882 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/0000000000000000004 2023-07-11 18:07:39,919 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-11 18:07:39,922 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/0000000000000000004 2023-07-11 18:07:39,922 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 2 edits, skipped 0 edits in 0 ms) 2023-07-11 18:07:39,931 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/0000000000000000005 2023-07-11 18:07:39,947 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 2 ms) 2023-07-11 18:07:39,949 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/0000000000000000004 2023-07-11 18:07:39,962 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 18:07:39,964 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/0000000000000000004 2023-07-11 18:07:39,974 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 18:07:39,977 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/0000000000000000004 2023-07-11 18:07:39,981 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-11 18:07:39,982 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/0000000000000000004 2023-07-11 18:07:39,983 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(423): Processed 19 edits across 9 Regions in 226 ms; skipped=9; WAL=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, size=291.3 K, length=298331, corrupted=false, cancelled=false 2023-07-11 18:07:39,983 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(426): Completed split of hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, journal: Splitting hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, size=291.3 K (298331bytes) at 1689098859748Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp at 1689098859764 (+16 ms)Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp at 1689098859780 (+16 ms)Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp at 1689098859784 (+4 ms)Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp at 1689098859790 (+6 ms)Split 9 edits, skipped 9 edits. at 1689098859791 (+1 ms)Finishing writing output for hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736 so closing down at 1689098859794 (+3 ms)Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp at 1689098859798 (+4 ms)Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp at 1689098859798Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp at 1689098859798Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp at 1689098859804 (+6 ms)Creating recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp at 1689098859806 (+2 ms)3 split writer threads finished at 1689098859807 (+1 ms)Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689098859858 (+51 ms)Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/0000000000000000004 at 1689098859867 (+9 ms)Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 2 ms) at 1689098859869 (+2 ms)Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/0000000000000000004 at 1689098859873 (+4 ms)Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689098859879 (+6 ms)Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/0000000000000000004 at 1689098859882 (+3 ms)Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689098859919 (+37 ms)Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/0000000000000000004 at 1689098859922 (+3 ms)Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 2 edits, skipped 0 edits in 0 ms) at 1689098859923 (+1 ms)Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/0000000000000000005 at 1689098859931 (+8 ms)Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 2 ms) at 1689098859947 (+16 ms)Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/0000000000000000004 at 1689098859949 (+2 ms)Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689098859962 (+13 ms)Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/0000000000000000004 at 1689098859964 (+2 ms)Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689098859974 (+10 ms)Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/0000000000000000004 at 1689098859977 (+3 ms)Closed recovered edits writer path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689098859981 (+4 ms)Rename recovered edits hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736.temp to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/0000000000000000004 at 1689098859982 (+1 ms)Processed 19 edits across 9 Regions in 226 ms; skipped=9; WAL=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, size=291.3 K, length=298331, corrupted=false, cancelled=false at 1689098859983 (+1 ms) 2023-07-11 18:07:39,983 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736 2023-07-11 18:07:39,983 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=68 2023-07-11 18:07:39,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] master.HMaster(3641): Remote procedure done, pid=68 2023-07-11 18:07:39,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35481] wal.WALSplitUtil(141): Moved hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting/jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736 to hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/oldWALs 2023-07-11 18:07:39,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-07-11 18:07:39,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 in 406 msec 2023-07-11 18:07:39,991 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:39,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=62 2023-07-11 18:07:39,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 in 413 msec 2023-07-11 18:07:39,995 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting dir is empty, no logs to split. 2023-07-11 18:07:39,995 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38785,1689098706958 WAL count=0, meta=false 2023-07-11 18:07:39,995 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase9.apache.org,38785,1689098706958 WAL splitting is done? wals=0, meta=false 2023-07-11 18:07:39,996 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 18:07:39,996 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:39,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:07:39,996 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 18:07:40,076 INFO [Listener at localhost/46025] procedure.MasterProcedureTestingUtility(454): Restart 6 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:40,076 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 18:07:40,076 INFO [Listener at localhost/46025] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 18:07:40,076 INFO [Listener at localhost/46025] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:07:40,077 ERROR [Listener at localhost/46025] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 18:07:40,077 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 18:07:40,077 INFO [Listener at localhost/46025] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 18:07:40,077 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 18:07:40,077 INFO [Listener at localhost/46025] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:07:40,078 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 18:07:40,079 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18] 2023-07-11 18:07:40,080 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 18:07:40,080 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 18:07:40,080 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-11 18:07:40,080 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-11 18:07:40,080 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 18:07:40,080 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 18:07:40,080 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 18:07:40,081 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 18:07:40,081 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 18:07:40,081 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:07:40,082 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 18:07:40,082 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,083 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,084 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-11 18:07:40,084 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 18:07:40,085 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,33801,1689098707010, table=hbase:meta, region=1588230740 2023-07-11 18:07:40,085 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689098890085 2023-07-11 18:07:40,086 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:07:40,090 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca21663676d98522661b9a7b1a038300, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,090 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=e6114557edd3e2be4679297c99dbb707, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,091 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cfeeac3165a77206892059eaf409a93a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,091 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=68a671ac00030280ed3c9b59840a157c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,091 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66c52954a1e65ac4eea3ad65ab781210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,092 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=34ae1cb300031e6413911b11bb3c0613, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,092 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=a535c854541161846ee0519898cadf3f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,092 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1e821bd6d21478c1aef93851d0f84803, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,092 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=6fd79949daf97fb71187ed6ccb826c85, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,093 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca97340b0ab43753a8263ae334c5b475, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,093 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9d068f7fd612d2e21c191a1d38a29723, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,093 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c41300b446f1c31843a2ac322189ac5c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,093 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=01c403825db7c339c13e2f1101543b42, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,094 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c07a104cc172022c4212e2e7a10199ba, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,094 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1851532129addae5c0e78c4af9fe4b41, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,094 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9e32425e5b5ae93a85c8ed8a3e29ad2a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,094 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=697385c0414f8f3b285f33f1ce166651, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,095 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3a49a7d0f0c324e9e04b887b069379ae, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,095 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=12ffd9ba99aec19d05a9a4bdc190df5e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,095 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3fda35ffdbf54a7596d1f6e9dd4c3a45, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,095 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cc5337c98b33958209dee082b9968414, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,096 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=8360d53793b402665c7d088b5757078c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,096 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66f3e358060a5746d9b9f7c8e30affd1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,096 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=082ae0e1538d0ea4afa6018633714d86, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,096 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f4618a109b5b547019676f2a63009dd7, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,097 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9dd9757b1ce8f958386c6599a273f3ee, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,097 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f32630ccb5e2306ee100dad5b0bd664e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,097 INFO [Listener at localhost/46025] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 18:07:40,097 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689098920097 2023-07-11 18:07:40,097 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689098980097 2023-07-11 18:07:40,097 INFO [Listener at localhost/46025] assignment.AssignmentManager(1536): Joined the cluster in 11 msec 2023-07-11 18:07:40,099 INFO [PEWorker-1] master.MasterWalManager(320): Log dir for server jenkins-hbase9.apache.org,38785,1689098706958 does not exist 2023-07-11 18:07:40,099 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38785,1689098706958 WAL count=0, meta=false 2023-07-11 18:07:40,099 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase9.apache.org,38785,1689098706958 WAL splitting is done? wals=0, meta=false 2023-07-11 18:07:40,100 INFO [PEWorker-1] procedure.ServerCrashProcedure(282): Remove WAL directory for jenkins-hbase9.apache.org,38785,1689098706958 failed, ignore...File hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/WALs/jenkins-hbase9.apache.org,38785,1689098706958-splitting does not exist. 2023-07-11 18:07:40,100 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 18:07:40,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6114557edd3e2be4679297c99dbb707, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34ae1cb300031e6413911b11bb3c0613, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=12ffd9ba99aec19d05a9a4bdc190df5e, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=082ae0e1538d0ea4afa6018633714d86, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fd79949daf97fb71187ed6ccb826c85, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c41300b446f1c31843a2ac322189ac5c, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ca21663676d98522661b9a7b1a038300, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8360d53793b402665c7d088b5757078c, ASSIGN}, {pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e32425e5b5ae93a85c8ed8a3e29ad2a, ASSIGN}] 2023-07-11 18:07:40,101 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 18:07:40,101 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:40,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:07:40,102 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 18:07:40,348 INFO [Listener at localhost/46025] procedure.MasterProcedureTestingUtility(454): Restart 7 exec state=pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:40,348 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 18:07:40,348 INFO [Listener at localhost/46025] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 18:07:40,348 INFO [Listener at localhost/46025] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:07:40,348 ERROR [Listener at localhost/46025] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 18:07:40,348 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 18:07:40,348 INFO [Listener at localhost/46025] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 18:07:40,348 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 18:07:40,349 INFO [Listener at localhost/46025] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:07:40,349 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 18:07:40,350 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25] 2023-07-11 18:07:40,351 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 18:07:40,351 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 18:07:40,351 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-11 18:07:40,351 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-11 18:07:40,351 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 18:07:40,351 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 18:07:40,351 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 18:07:40,352 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 18:07:40,352 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 18:07:40,353 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:07:40,354 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 18:07:40,355 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:40,355 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,355 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,355 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 18:07:40,355 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,355 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,355 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,355 DEBUG [Listener at localhost/46025] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 18:07:40,356 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,356 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,356 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,356 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,356 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,356 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:40,356 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 6 msec 2023-07-11 18:07:40,357 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 18:07:40,358 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,33801,1689098707010, table=hbase:meta, region=1588230740 2023-07-11 18:07:40,358 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689098890358 2023-07-11 18:07:40,359 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:07:40,363 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca21663676d98522661b9a7b1a038300, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,363 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=e6114557edd3e2be4679297c99dbb707, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,363 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cfeeac3165a77206892059eaf409a93a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,364 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=68a671ac00030280ed3c9b59840a157c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,364 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66c52954a1e65ac4eea3ad65ab781210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,364 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=34ae1cb300031e6413911b11bb3c0613, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,364 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=a535c854541161846ee0519898cadf3f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,365 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1e821bd6d21478c1aef93851d0f84803, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,365 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=6fd79949daf97fb71187ed6ccb826c85, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,365 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca97340b0ab43753a8263ae334c5b475, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,365 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9d068f7fd612d2e21c191a1d38a29723, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,366 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c41300b446f1c31843a2ac322189ac5c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,366 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=01c403825db7c339c13e2f1101543b42, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,366 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c07a104cc172022c4212e2e7a10199ba, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,366 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1851532129addae5c0e78c4af9fe4b41, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,367 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9e32425e5b5ae93a85c8ed8a3e29ad2a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,367 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=697385c0414f8f3b285f33f1ce166651, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,367 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3a49a7d0f0c324e9e04b887b069379ae, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,368 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=12ffd9ba99aec19d05a9a4bdc190df5e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,368 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3fda35ffdbf54a7596d1f6e9dd4c3a45, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,368 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cc5337c98b33958209dee082b9968414, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,368 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=8360d53793b402665c7d088b5757078c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,369 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66f3e358060a5746d9b9f7c8e30affd1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,369 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=082ae0e1538d0ea4afa6018633714d86, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38785,1689098706958, regionLocation=jenkins-hbase9.apache.org,38785,1689098706958, openSeqNum=2 2023-07-11 18:07:40,369 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f4618a109b5b547019676f2a63009dd7, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,369 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9dd9757b1ce8f958386c6599a273f3ee, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:40,370 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f32630ccb5e2306ee100dad5b0bd664e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:40,370 INFO [Listener at localhost/46025] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 18:07:40,370 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689098920370 2023-07-11 18:07:40,370 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689098980370 2023-07-11 18:07:40,370 INFO [Listener at localhost/46025] assignment.AssignmentManager(1536): Joined the cluster in 11 msec 2023-07-11 18:07:40,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6114557edd3e2be4679297c99dbb707, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34ae1cb300031e6413911b11bb3c0613, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=12ffd9ba99aec19d05a9a4bdc190df5e, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=082ae0e1538d0ea4afa6018633714d86, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fd79949daf97fb71187ed6ccb826c85, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c41300b446f1c31843a2ac322189ac5c, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ca21663676d98522661b9a7b1a038300, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8360d53793b402665c7d088b5757078c, ASSIGN}, {pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e32425e5b5ae93a85c8ed8a3e29ad2a, ASSIGN}] 2023-07-11 18:07:40,372 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 18:07:40,373 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ca21663676d98522661b9a7b1a038300, ASSIGN 2023-07-11 18:07:40,374 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ca21663676d98522661b9a7b1a038300, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 18:07:40,375 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e32425e5b5ae93a85c8ed8a3e29ad2a, ASSIGN 2023-07-11 18:07:40,375 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e32425e5b5ae93a85c8ed8a3e29ad2a, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 18:07:40,376 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8360d53793b402665c7d088b5757078c, ASSIGN 2023-07-11 18:07:40,376 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8360d53793b402665c7d088b5757078c, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 18:07:40,377 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c41300b446f1c31843a2ac322189ac5c, ASSIGN 2023-07-11 18:07:40,378 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c41300b446f1c31843a2ac322189ac5c, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 18:07:40,378 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fd79949daf97fb71187ed6ccb826c85, ASSIGN 2023-07-11 18:07:40,379 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fd79949daf97fb71187ed6ccb826c85, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 18:07:40,380 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=082ae0e1538d0ea4afa6018633714d86, ASSIGN 2023-07-11 18:07:40,380 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=082ae0e1538d0ea4afa6018633714d86, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 18:07:40,381 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=12ffd9ba99aec19d05a9a4bdc190df5e, ASSIGN 2023-07-11 18:07:40,381 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=12ffd9ba99aec19d05a9a4bdc190df5e, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 18:07:40,382 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34ae1cb300031e6413911b11bb3c0613, ASSIGN 2023-07-11 18:07:40,383 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34ae1cb300031e6413911b11bb3c0613, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 18:07:40,383 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6114557edd3e2be4679297c99dbb707, ASSIGN 2023-07-11 18:07:40,384 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6114557edd3e2be4679297c99dbb707, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 18:07:40,524 DEBUG [jenkins-hbase9:35481] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-07-11 18:07:40,524 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:07:40,525 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:07:40,525 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:07:40,525 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:07:40,526 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:07:40,526 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=ca21663676d98522661b9a7b1a038300, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,526 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:07:40,526 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:07:40,526 DEBUG [jenkins-hbase9:35481] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:07:40,526 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689098860526"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098860526"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098860526"}]},"ts":"1689098860526"} 2023-07-11 18:07:40,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=78, ppid=75, state=RUNNABLE; OpenRegionProcedure ca21663676d98522661b9a7b1a038300, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:07:40,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=082ae0e1538d0ea4afa6018633714d86, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,535 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098860535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098860535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098860535"}]},"ts":"1689098860535"} 2023-07-11 18:07:40,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=79, ppid=72, state=RUNNABLE; OpenRegionProcedure 082ae0e1538d0ea4afa6018633714d86, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:07:40,539 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=12ffd9ba99aec19d05a9a4bdc190df5e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,539 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098860539"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098860539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098860539"}]},"ts":"1689098860539"} 2023-07-11 18:07:40,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=71, state=RUNNABLE; OpenRegionProcedure 12ffd9ba99aec19d05a9a4bdc190df5e, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:07:40,545 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=c41300b446f1c31843a2ac322189ac5c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,546 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098860545"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098860545"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098860545"}]},"ts":"1689098860545"} 2023-07-11 18:07:40,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=74, state=RUNNABLE; OpenRegionProcedure c41300b446f1c31843a2ac322189ac5c, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:07:40,550 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=34ae1cb300031e6413911b11bb3c0613, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,550 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098860550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098860550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098860550"}]},"ts":"1689098860550"} 2023-07-11 18:07:40,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=70, state=RUNNABLE; OpenRegionProcedure 34ae1cb300031e6413911b11bb3c0613, server=jenkins-hbase9.apache.org,36619,1689098707062}] 2023-07-11 18:07:40,554 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=8360d53793b402665c7d088b5757078c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,554 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098860554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098860554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098860554"}]},"ts":"1689098860554"} 2023-07-11 18:07:40,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=76, state=RUNNABLE; OpenRegionProcedure 8360d53793b402665c7d088b5757078c, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:07:40,558 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=77 updating hbase:meta row=9e32425e5b5ae93a85c8ed8a3e29ad2a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,558 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098860558"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098860558"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098860558"}]},"ts":"1689098860558"} 2023-07-11 18:07:40,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=77, state=RUNNABLE; OpenRegionProcedure 9e32425e5b5ae93a85c8ed8a3e29ad2a, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:07:40,563 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6fd79949daf97fb71187ed6ccb826c85, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,563 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098860563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098860563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098860563"}]},"ts":"1689098860563"} 2023-07-11 18:07:40,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=73, state=RUNNABLE; OpenRegionProcedure 6fd79949daf97fb71187ed6ccb826c85, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:07:40,567 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=e6114557edd3e2be4679297c99dbb707, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,567 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689098860567"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098860567"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098860567"}]},"ts":"1689098860567"} 2023-07-11 18:07:40,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=86, ppid=69, state=RUNNABLE; OpenRegionProcedure e6114557edd3e2be4679297c99dbb707, server=jenkins-hbase9.apache.org,33801,1689098707010}] 2023-07-11 18:07:40,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:07:40,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12ffd9ba99aec19d05a9a4bdc190df5e, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e.', STARTKEY => 'rrr', ENDKEY => 'sss'} 2023-07-11 18:07:40,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:07:40,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:07:40,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:07:40,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:07:40,692 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:07:40,693 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:07:40,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca21663676d98522661b9a7b1a038300, NAME => 'hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:07:40,693 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily11 2023-07-11 18:07:40,693 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily11 2023-07-11 18:07:40,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ca21663676d98522661b9a7b1a038300 2023-07-11 18:07:40,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:07:40,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ca21663676d98522661b9a7b1a038300 2023-07-11 18:07:40,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ca21663676d98522661b9a7b1a038300 2023-07-11 18:07:40,693 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12ffd9ba99aec19d05a9a4bdc190df5e columnFamilyName colfamily11 2023-07-11 18:07:40,694 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(310): Store=12ffd9ba99aec19d05a9a4bdc190df5e/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,694 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:07:40,694 INFO [StoreOpener-ca21663676d98522661b9a7b1a038300-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ca21663676d98522661b9a7b1a038300 2023-07-11 18:07:40,695 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily21 2023-07-11 18:07:40,695 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily21 2023-07-11 18:07:40,695 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12ffd9ba99aec19d05a9a4bdc190df5e columnFamilyName colfamily21 2023-07-11 18:07:40,695 DEBUG [StoreOpener-ca21663676d98522661b9a7b1a038300-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/info 2023-07-11 18:07:40,695 DEBUG [StoreOpener-ca21663676d98522661b9a7b1a038300-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/info 2023-07-11 18:07:40,696 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(310): Store=12ffd9ba99aec19d05a9a4bdc190df5e/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,696 INFO [StoreOpener-ca21663676d98522661b9a7b1a038300-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca21663676d98522661b9a7b1a038300 columnFamilyName info 2023-07-11 18:07:40,696 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:07:40,696 INFO [StoreOpener-ca21663676d98522661b9a7b1a038300-1] regionserver.HStore(310): Store=ca21663676d98522661b9a7b1a038300/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,697 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily31 2023-07-11 18:07:40,697 DEBUG [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily31 2023-07-11 18:07:40,697 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300 2023-07-11 18:07:40,697 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12ffd9ba99aec19d05a9a4bdc190df5e columnFamilyName colfamily31 2023-07-11 18:07:40,698 INFO [StoreOpener-12ffd9ba99aec19d05a9a4bdc190df5e-1] regionserver.HStore(310): Store=12ffd9ba99aec19d05a9a4bdc190df5e/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:07:40,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300 2023-07-11 18:07:40,700 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/0000000000000000005 2023-07-11 18:07:40,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:07:40,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/0000000000000000004 2023-07-11 18:07:40,704 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 2, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=5, path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/0000000000000000005 2023-07-11 18:07:40,704 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ca21663676d98522661b9a7b1a038300 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 18:07:40,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/0000000000000000004 2023-07-11 18:07:40,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 12ffd9ba99aec19d05a9a4bdc190df5e 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:40,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:07:40,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e32425e5b5ae93a85c8ed8a3e29ad2a, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a.', STARTKEY => 'ooo', ENDKEY => 'ppp'} 2023-07-11 18:07:40,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:07:40,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:07:40,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:07:40,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:07:40,723 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:07:40,726 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily11 2023-07-11 18:07:40,726 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily11 2023-07-11 18:07:40,726 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e32425e5b5ae93a85c8ed8a3e29ad2a columnFamilyName colfamily11 2023-07-11 18:07:40,727 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(310): Store=9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,727 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:07:40,728 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily21 2023-07-11 18:07:40,728 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily21 2023-07-11 18:07:40,729 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e32425e5b5ae93a85c8ed8a3e29ad2a columnFamilyName colfamily21 2023-07-11 18:07:40,730 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(310): Store=9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,730 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:07:40,732 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily31 2023-07-11 18:07:40,732 DEBUG [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily31 2023-07-11 18:07:40,733 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e32425e5b5ae93a85c8ed8a3e29ad2a columnFamilyName colfamily31 2023-07-11 18:07:40,734 INFO [StoreOpener-9e32425e5b5ae93a85c8ed8a3e29ad2a-1] regionserver.HStore(310): Store=9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:07:40,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:07:40,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/0000000000000000004 2023-07-11 18:07:40,755 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/.tmp/info/9c8f6f251bb54ec8a5fb1341ca0a7022 2023-07-11 18:07:40,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/.tmp/colfamily11/74ac366309094864a16886d49430ec6d 2023-07-11 18:07:40,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/0000000000000000004 2023-07-11 18:07:40,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 9e32425e5b5ae93a85c8ed8a3e29ad2a 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:40,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/.tmp/info/9c8f6f251bb54ec8a5fb1341ca0a7022 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/info/9c8f6f251bb54ec8a5fb1341ca0a7022 2023-07-11 18:07:40,777 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/info/9c8f6f251bb54ec8a5fb1341ca0a7022, entries=2, sequenceid=5, filesize=4.8 K 2023-07-11 18:07:40,778 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ca21663676d98522661b9a7b1a038300 in 74ms, sequenceid=5, compaction requested=false; wal=null 2023-07-11 18:07:40,780 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/0000000000000000005 2023-07-11 18:07:40,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/.tmp/colfamily11/74ac366309094864a16886d49430ec6d as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily11/74ac366309094864a16886d49430ec6d 2023-07-11 18:07:40,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ca21663676d98522661b9a7b1a038300 2023-07-11 18:07:40,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/colfamily11/74ac366309094864a16886d49430ec6d, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 18:07:40,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 12ffd9ba99aec19d05a9a4bdc190df5e in 120ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 18:07:40,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/0000000000000000004 2023-07-11 18:07:40,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=1 2023-07-11 18:07:40,839 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ca21663676d98522661b9a7b1a038300; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73810665, jitterRate=0.09986461699008942}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:07:40,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ca21663676d98522661b9a7b1a038300: 2023-07-11 18:07:40,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:07:40,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/.tmp/colfamily11/a9fa6862ce9743ba8a8aa69e01074864 2023-07-11 18:07:40,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:07:40,843 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300., pid=78, masterSystemTime=1689098860684 2023-07-11 18:07:40,845 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=ca21663676d98522661b9a7b1a038300, regionState=OPEN, openSeqNum=6, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,846 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689098860845"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098860845"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098860845"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098860845"}]},"ts":"1689098860845"} 2023-07-11 18:07:40,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:07:40,846 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:07:40,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 18:07:40,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=78, resume processing ppid=75 2023-07-11 18:07:40,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 12ffd9ba99aec19d05a9a4bdc190df5e; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71730419, jitterRate=0.0688665360212326}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:07:40,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, ppid=75, state=SUCCESS; OpenRegionProcedure ca21663676d98522661b9a7b1a038300, server=jenkins-hbase9.apache.org,36619,1689098707062 in 317 msec 2023-07-11 18:07:40,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 12ffd9ba99aec19d05a9a4bdc190df5e: 2023-07-11 18:07:40,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e., pid=80, masterSystemTime=1689098860684 2023-07-11 18:07:40,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ca21663676d98522661b9a7b1a038300, ASSIGN in 480 msec 2023-07-11 18:07:40,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:07:40,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:07:40,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:07:40,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 082ae0e1538d0ea4afa6018633714d86, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86.', STARTKEY => 'www', ENDKEY => 'xxx'} 2023-07-11 18:07:40,855 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=12ffd9ba99aec19d05a9a4bdc190df5e, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/.tmp/colfamily11/a9fa6862ce9743ba8a8aa69e01074864 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily11/a9fa6862ce9743ba8a8aa69e01074864 2023-07-11 18:07:40,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:07:40,855 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098860855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098860855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098860855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098860855"}]},"ts":"1689098860855"} 2023-07-11 18:07:40,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:07:40,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:07:40,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:07:40,857 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:07:40,859 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily11 2023-07-11 18:07:40,859 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily11 2023-07-11 18:07:40,859 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 082ae0e1538d0ea4afa6018633714d86 columnFamilyName colfamily11 2023-07-11 18:07:40,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=71 2023-07-11 18:07:40,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=71, state=SUCCESS; OpenRegionProcedure 12ffd9ba99aec19d05a9a4bdc190df5e, server=jenkins-hbase9.apache.org,36619,1689098707062 in 315 msec 2023-07-11 18:07:40,860 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(310): Store=082ae0e1538d0ea4afa6018633714d86/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,860 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:07:40,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=12ffd9ba99aec19d05a9a4bdc190df5e, ASSIGN in 490 msec 2023-07-11 18:07:40,862 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily21 2023-07-11 18:07:40,862 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily21 2023-07-11 18:07:40,862 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 082ae0e1538d0ea4afa6018633714d86 columnFamilyName colfamily21 2023-07-11 18:07:40,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/colfamily11/a9fa6862ce9743ba8a8aa69e01074864, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 18:07:40,863 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(310): Store=082ae0e1538d0ea4afa6018633714d86/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,863 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:07:40,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 9e32425e5b5ae93a85c8ed8a3e29ad2a in 98ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 18:07:40,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/0000000000000000004 2023-07-11 18:07:40,864 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily31 2023-07-11 18:07:40,864 DEBUG [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily31 2023-07-11 18:07:40,864 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 082ae0e1538d0ea4afa6018633714d86 columnFamilyName colfamily31 2023-07-11 18:07:40,865 INFO [StoreOpener-082ae0e1538d0ea4afa6018633714d86-1] regionserver.HStore(310): Store=082ae0e1538d0ea4afa6018633714d86/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:07:40,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:07:40,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:07:40,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/0000000000000000004 2023-07-11 18:07:40,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:07:40,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 18:07:40,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9e32425e5b5ae93a85c8ed8a3e29ad2a; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58812750, jitterRate=-0.12362173199653625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:07:40,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9e32425e5b5ae93a85c8ed8a3e29ad2a: 2023-07-11 18:07:40,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a., pid=84, masterSystemTime=1689098860706 2023-07-11 18:07:40,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/0000000000000000004 2023-07-11 18:07:40,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 082ae0e1538d0ea4afa6018633714d86 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:40,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:07:40,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:07:40,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:07:40,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6fd79949daf97fb71187ed6ccb826c85, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85.', STARTKEY => 'hhh', ENDKEY => 'iii'} 2023-07-11 18:07:40,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:07:40,875 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=77 updating hbase:meta row=9e32425e5b5ae93a85c8ed8a3e29ad2a, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:07:40,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:07:40,875 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098860875"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098860875"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098860875"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098860875"}]},"ts":"1689098860875"} 2023-07-11 18:07:40,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:07:40,877 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:07:40,878 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily11 2023-07-11 18:07:40,878 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily11 2023-07-11 18:07:40,879 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fd79949daf97fb71187ed6ccb826c85 columnFamilyName colfamily11 2023-07-11 18:07:40,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=77 2023-07-11 18:07:40,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=77, state=SUCCESS; OpenRegionProcedure 9e32425e5b5ae93a85c8ed8a3e29ad2a, server=jenkins-hbase9.apache.org,33801,1689098707010 in 318 msec 2023-07-11 18:07:40,880 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(310): Store=6fd79949daf97fb71187ed6ccb826c85/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,880 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:07:40,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e32425e5b5ae93a85c8ed8a3e29ad2a, ASSIGN in 508 msec 2023-07-11 18:07:40,882 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily21 2023-07-11 18:07:40,882 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily21 2023-07-11 18:07:40,882 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fd79949daf97fb71187ed6ccb826c85 columnFamilyName colfamily21 2023-07-11 18:07:40,883 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(310): Store=6fd79949daf97fb71187ed6ccb826c85/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,883 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:07:40,884 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily31 2023-07-11 18:07:40,884 DEBUG [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily31 2023-07-11 18:07:40,884 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fd79949daf97fb71187ed6ccb826c85 columnFamilyName colfamily31 2023-07-11 18:07:40,885 INFO [StoreOpener-6fd79949daf97fb71187ed6ccb826c85-1] regionserver.HStore(310): Store=6fd79949daf97fb71187ed6ccb826c85/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:07:40,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:07:40,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/0000000000000000004 2023-07-11 18:07:40,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/.tmp/colfamily11/9320d966129a4522ba36435ba78da3d0 2023-07-11 18:07:40,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/0000000000000000004 2023-07-11 18:07:40,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 6fd79949daf97fb71187ed6ccb826c85 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:40,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/.tmp/colfamily11/9320d966129a4522ba36435ba78da3d0 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily11/9320d966129a4522ba36435ba78da3d0 2023-07-11 18:07:40,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/colfamily11/9320d966129a4522ba36435ba78da3d0, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 18:07:40,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 082ae0e1538d0ea4afa6018633714d86 in 37ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 18:07:40,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/0000000000000000004 2023-07-11 18:07:40,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:07:40,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:07:40,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/.tmp/colfamily11/8eaa140f422249b78d5abce1c678db2e 2023-07-11 18:07:40,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 18:07:40,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 082ae0e1538d0ea4afa6018633714d86; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74212824, jitterRate=0.105857253074646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:07:40,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 082ae0e1538d0ea4afa6018633714d86: 2023-07-11 18:07:40,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86., pid=79, masterSystemTime=1689098860684 2023-07-11 18:07:40,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:07:40,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:07:40,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:07:40,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34ae1cb300031e6413911b11bb3c0613, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613.', STARTKEY => 'eee', ENDKEY => 'fff'} 2023-07-11 18:07:40,925 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=082ae0e1538d0ea4afa6018633714d86, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:40,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:07:40,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:07:40,925 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098860925"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098860925"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098860925"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098860925"}]},"ts":"1689098860925"} 2023-07-11 18:07:40,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:07:40,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:07:40,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/.tmp/colfamily11/8eaa140f422249b78d5abce1c678db2e as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily11/8eaa140f422249b78d5abce1c678db2e 2023-07-11 18:07:40,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=79, resume processing ppid=72 2023-07-11 18:07:40,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, ppid=72, state=SUCCESS; OpenRegionProcedure 082ae0e1538d0ea4afa6018633714d86, server=jenkins-hbase9.apache.org,36619,1689098707062 in 391 msec 2023-07-11 18:07:40,930 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:07:40,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=082ae0e1538d0ea4afa6018633714d86, ASSIGN in 559 msec 2023-07-11 18:07:40,933 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily11 2023-07-11 18:07:40,933 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily11 2023-07-11 18:07:40,933 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34ae1cb300031e6413911b11bb3c0613 columnFamilyName colfamily11 2023-07-11 18:07:40,934 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(310): Store=34ae1cb300031e6413911b11bb3c0613/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,934 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:07:40,935 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily21 2023-07-11 18:07:40,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/colfamily11/8eaa140f422249b78d5abce1c678db2e, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 18:07:40,935 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily21 2023-07-11 18:07:40,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 6fd79949daf97fb71187ed6ccb826c85 in 39ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 18:07:40,936 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34ae1cb300031e6413911b11bb3c0613 columnFamilyName colfamily21 2023-07-11 18:07:40,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/0000000000000000004 2023-07-11 18:07:40,937 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(310): Store=34ae1cb300031e6413911b11bb3c0613/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,937 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:07:40,938 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily31 2023-07-11 18:07:40,938 DEBUG [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily31 2023-07-11 18:07:40,939 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34ae1cb300031e6413911b11bb3c0613 columnFamilyName colfamily31 2023-07-11 18:07:40,939 INFO [StoreOpener-34ae1cb300031e6413911b11bb3c0613-1] regionserver.HStore(310): Store=34ae1cb300031e6413911b11bb3c0613/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:07:40,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:07:40,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:07:40,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:07:40,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/0000000000000000004 2023-07-11 18:07:40,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 18:07:40,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 6fd79949daf97fb71187ed6ccb826c85; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74600565, jitterRate=0.11163504421710968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:07:40,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 6fd79949daf97fb71187ed6ccb826c85: 2023-07-11 18:07:40,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85., pid=85, masterSystemTime=1689098860706 2023-07-11 18:07:40,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:07:40,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:07:40,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:07:40,948 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6fd79949daf97fb71187ed6ccb826c85, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:40,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6114557edd3e2be4679297c99dbb707, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707.', STARTKEY => '', ENDKEY => 'bbb'} 2023-07-11 18:07:40,948 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098860948"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098860948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098860948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098860948"}]},"ts":"1689098860948"} 2023-07-11 18:07:40,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:40,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:07:40,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:40,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:40,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/0000000000000000004 2023-07-11 18:07:40,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 34ae1cb300031e6413911b11bb3c0613 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:40,951 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:40,952 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily11 2023-07-11 18:07:40,953 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily11 2023-07-11 18:07:40,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=73 2023-07-11 18:07:40,953 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6114557edd3e2be4679297c99dbb707 columnFamilyName colfamily11 2023-07-11 18:07:40,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=73, state=SUCCESS; OpenRegionProcedure 6fd79949daf97fb71187ed6ccb826c85, server=jenkins-hbase9.apache.org,33801,1689098707010 in 386 msec 2023-07-11 18:07:40,954 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(310): Store=e6114557edd3e2be4679297c99dbb707/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,955 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:40,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fd79949daf97fb71187ed6ccb826c85, ASSIGN in 584 msec 2023-07-11 18:07:40,956 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily21 2023-07-11 18:07:40,956 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily21 2023-07-11 18:07:40,957 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6114557edd3e2be4679297c99dbb707 columnFamilyName colfamily21 2023-07-11 18:07:40,958 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(310): Store=e6114557edd3e2be4679297c99dbb707/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,958 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:40,959 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily31 2023-07-11 18:07:40,959 DEBUG [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily31 2023-07-11 18:07:40,960 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6114557edd3e2be4679297c99dbb707 columnFamilyName colfamily31 2023-07-11 18:07:40,960 INFO [StoreOpener-e6114557edd3e2be4679297c99dbb707-1] regionserver.HStore(310): Store=e6114557edd3e2be4679297c99dbb707/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:40,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:40,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:40,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/0000000000000000004 2023-07-11 18:07:40,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/0000000000000000004 2023-07-11 18:07:40,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing e6114557edd3e2be4679297c99dbb707 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:40,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/.tmp/colfamily11/fda2cd90eef847789700b596fee0b1d6 2023-07-11 18:07:40,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/.tmp/colfamily11/fda2cd90eef847789700b596fee0b1d6 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily11/fda2cd90eef847789700b596fee0b1d6 2023-07-11 18:07:40,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/.tmp/colfamily11/4ea5b834b37144849ccba5765f4bc379 2023-07-11 18:07:40,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/colfamily11/fda2cd90eef847789700b596fee0b1d6, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 18:07:40,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 34ae1cb300031e6413911b11bb3c0613 in 41ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 18:07:40,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/0000000000000000004 2023-07-11 18:07:40,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:07:40,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:07:40,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/.tmp/colfamily11/4ea5b834b37144849ccba5765f4bc379 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily11/4ea5b834b37144849ccba5765f4bc379 2023-07-11 18:07:41,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/colfamily11/4ea5b834b37144849ccba5765f4bc379, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 18:07:41,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for e6114557edd3e2be4679297c99dbb707 in 31ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 18:07:41,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 18:07:41,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/0000000000000000004 2023-07-11 18:07:41,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 34ae1cb300031e6413911b11bb3c0613; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68977124, jitterRate=0.027839243412017822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:07:41,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 34ae1cb300031e6413911b11bb3c0613: 2023-07-11 18:07:41,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613., pid=82, masterSystemTime=1689098860684 2023-07-11 18:07:41,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:07:41,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:07:41,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:07:41,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:07:41,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c41300b446f1c31843a2ac322189ac5c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2023-07-11 18:07:41,008 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=34ae1cb300031e6413911b11bb3c0613, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:41,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:07:41,008 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098861008"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098861008"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098861008"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098861008"}]},"ts":"1689098861008"} 2023-07-11 18:07:41,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:07:41,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:07:41,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:07:41,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:41,010 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:07:41,011 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily11 2023-07-11 18:07:41,011 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily11 2023-07-11 18:07:41,012 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c41300b446f1c31843a2ac322189ac5c columnFamilyName colfamily11 2023-07-11 18:07:41,012 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(310): Store=c41300b446f1c31843a2ac322189ac5c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:41,013 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:07:41,014 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily21 2023-07-11 18:07:41,014 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily21 2023-07-11 18:07:41,014 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c41300b446f1c31843a2ac322189ac5c columnFamilyName colfamily21 2023-07-11 18:07:41,014 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(310): Store=c41300b446f1c31843a2ac322189ac5c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:41,015 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:07:41,016 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily31 2023-07-11 18:07:41,016 DEBUG [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily31 2023-07-11 18:07:41,016 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c41300b446f1c31843a2ac322189ac5c columnFamilyName colfamily31 2023-07-11 18:07:41,016 INFO [StoreOpener-c41300b446f1c31843a2ac322189ac5c-1] regionserver.HStore(310): Store=c41300b446f1c31843a2ac322189ac5c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:41,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:07:41,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=70 2023-07-11 18:07:41,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 18:07:41,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=70, state=SUCCESS; OpenRegionProcedure 34ae1cb300031e6413911b11bb3c0613, server=jenkins-hbase9.apache.org,36619,1689098707062 in 459 msec 2023-07-11 18:07:41,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:07:41,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e6114557edd3e2be4679297c99dbb707; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67841344, jitterRate=0.010914802551269531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:07:41,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e6114557edd3e2be4679297c99dbb707: 2023-07-11 18:07:41,020 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34ae1cb300031e6413911b11bb3c0613, ASSIGN in 648 msec 2023-07-11 18:07:41,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/0000000000000000004 2023-07-11 18:07:41,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707., pid=86, masterSystemTime=1689098860706 2023-07-11 18:07:41,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:07:41,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:07:41,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:07:41,025 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=e6114557edd3e2be4679297c99dbb707, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:41,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8360d53793b402665c7d088b5757078c, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2023-07-11 18:07:41,025 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689098861025"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098861025"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098861025"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098861025"}]},"ts":"1689098861025"} 2023-07-11 18:07:41,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 8360d53793b402665c7d088b5757078c 2023-07-11 18:07:41,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:07:41,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8360d53793b402665c7d088b5757078c 2023-07-11 18:07:41,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8360d53793b402665c7d088b5757078c 2023-07-11 18:07:41,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/0000000000000000004 2023-07-11 18:07:41,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing c41300b446f1c31843a2ac322189ac5c 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:41,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=69 2023-07-11 18:07:41,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=69, state=SUCCESS; OpenRegionProcedure e6114557edd3e2be4679297c99dbb707, server=jenkins-hbase9.apache.org,33801,1689098707010 in 459 msec 2023-07-11 18:07:41,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6114557edd3e2be4679297c99dbb707, ASSIGN in 659 msec 2023-07-11 18:07:41,038 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 8360d53793b402665c7d088b5757078c 2023-07-11 18:07:41,039 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily11 2023-07-11 18:07:41,039 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily11 2023-07-11 18:07:41,039 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8360d53793b402665c7d088b5757078c columnFamilyName colfamily11 2023-07-11 18:07:41,042 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(310): Store=8360d53793b402665c7d088b5757078c/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:41,042 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 8360d53793b402665c7d088b5757078c 2023-07-11 18:07:41,043 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily21 2023-07-11 18:07:41,043 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily21 2023-07-11 18:07:41,044 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8360d53793b402665c7d088b5757078c columnFamilyName colfamily21 2023-07-11 18:07:41,044 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(310): Store=8360d53793b402665c7d088b5757078c/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:41,045 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 8360d53793b402665c7d088b5757078c 2023-07-11 18:07:41,045 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily31 2023-07-11 18:07:41,045 DEBUG [StoreOpener-8360d53793b402665c7d088b5757078c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily31 2023-07-11 18:07:41,046 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8360d53793b402665c7d088b5757078c columnFamilyName colfamily31 2023-07-11 18:07:41,046 INFO [StoreOpener-8360d53793b402665c7d088b5757078c-1] regionserver.HStore(310): Store=8360d53793b402665c7d088b5757078c/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:07:41,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c 2023-07-11 18:07:41,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c 2023-07-11 18:07:41,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/0000000000000000004 2023-07-11 18:07:41,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/.tmp/colfamily11/0ffa259c22874638bf816b919e0d7573 2023-07-11 18:07:41,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/0000000000000000004 2023-07-11 18:07:41,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 8360d53793b402665c7d088b5757078c 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:41,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/.tmp/colfamily11/0ffa259c22874638bf816b919e0d7573 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily11/0ffa259c22874638bf816b919e0d7573 2023-07-11 18:07:41,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/colfamily11/0ffa259c22874638bf816b919e0d7573, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 18:07:41,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for c41300b446f1c31843a2ac322189ac5c in 48ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 18:07:41,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/0000000000000000004 2023-07-11 18:07:41,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:07:41,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:07:41,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 18:07:41,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c41300b446f1c31843a2ac322189ac5c; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67749642, jitterRate=0.009548336267471313}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:07:41,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c41300b446f1c31843a2ac322189ac5c: 2023-07-11 18:07:41,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c., pid=81, masterSystemTime=1689098860684 2023-07-11 18:07:41,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:07:41,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:07:41,089 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=c41300b446f1c31843a2ac322189ac5c, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:41,089 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098861088"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098861088"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098861088"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098861088"}]},"ts":"1689098861088"} 2023-07-11 18:07:41,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/.tmp/colfamily11/013b64deb9c1446596045fce8836cec3 2023-07-11 18:07:41,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=74 2023-07-11 18:07:41,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=74, state=SUCCESS; OpenRegionProcedure c41300b446f1c31843a2ac322189ac5c, server=jenkins-hbase9.apache.org,36619,1689098707062 in 543 msec 2023-07-11 18:07:41,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c41300b446f1c31843a2ac322189ac5c, ASSIGN in 721 msec 2023-07-11 18:07:41,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/.tmp/colfamily11/013b64deb9c1446596045fce8836cec3 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily11/013b64deb9c1446596045fce8836cec3 2023-07-11 18:07:41,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/colfamily11/013b64deb9c1446596045fce8836cec3, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 18:07:41,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 8360d53793b402665c7d088b5757078c in 41ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 18:07:41,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/0000000000000000004 2023-07-11 18:07:41,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:07:41,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8360d53793b402665c7d088b5757078c 2023-07-11 18:07:41,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 18:07:41,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8360d53793b402665c7d088b5757078c; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65680447, jitterRate=-0.021285071969032288}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:07:41,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8360d53793b402665c7d088b5757078c: 2023-07-11 18:07:41,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c., pid=83, masterSystemTime=1689098860706 2023-07-11 18:07:41,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:07:41,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:07:41,114 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=8360d53793b402665c7d088b5757078c, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:41,115 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689098861114"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098861114"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098861114"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098861114"}]},"ts":"1689098861114"} 2023-07-11 18:07:41,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=76 2023-07-11 18:07:41,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=76, state=SUCCESS; OpenRegionProcedure 8360d53793b402665c7d088b5757078c, server=jenkins-hbase9.apache.org,33801,1689098707010 in 561 msec 2023-07-11 18:07:41,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=62 2023-07-11 18:07:41,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8360d53793b402665c7d088b5757078c, ASSIGN in 746 msec 2023-07-11 18:07:41,120 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase9.apache.org,38785,1689098706958 after splitting done 2023-07-11 18:07:41,120 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase9.apache.org,38785,1689098706958 from processing; numProcessing=0 2023-07-11 18:07:41,120 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 18:07:41,120 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:41,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:07:41,120 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 18:07:41,121 INFO [Listener at localhost/46025] procedure.MasterProcedureTestingUtility(454): Restart 8 exec state=pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:41,121 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 18:07:41,122 INFO [Listener at localhost/46025] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 18:07:41,122 INFO [Listener at localhost/46025] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:07:41,122 ERROR [Listener at localhost/46025] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 18:07:41,122 INFO [Listener at localhost/46025] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 18:07:41,122 INFO [Listener at localhost/46025] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 18:07:41,123 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 18:07:41,123 INFO [Listener at localhost/46025] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:07:41,123 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 18:07:41,124 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25, 26, 27] 2023-07-11 18:07:41,124 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 18:07:41,124 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 18:07:41,124 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-11 18:07:41,124 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=69, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[36, 53, 68] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=86, ppid=69, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[54, 67] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=70, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[35, 45, 66] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=82, ppid=70, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[46, 65] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=71, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[34, 41, 58] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=80, ppid=71, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[42, 57] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=72, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[33, 39, 62] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=79, ppid=72, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[40, 61] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=73, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[32, 51, 64] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=85, ppid=73, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[52, 63] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=74, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[31, 43, 70] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=81, ppid=74, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[44, 69] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=75, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[28, 37, 56] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=78, ppid=75, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[38, 55] 2023-07-11 18:07:41,125 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=76, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[30, 47, 72] 2023-07-11 18:07:41,126 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=83, ppid=76, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[48, 71] 2023-07-11 18:07:41,126 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=77, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[29, 49, 60] 2023-07-11 18:07:41,126 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=84, ppid=77, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[50, 59] 2023-07-11 18:07:41,126 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 18:07:41,126 DEBUG [Listener at localhost/46025] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 18:07:41,126 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 18:07:41,126 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 18:07:41,127 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 18:07:41,127 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:07:41,127 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 18:07:41,130 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true 2023-07-11 18:07:41,130 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:41,130 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:41,130 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 18:07:41,130 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:41,130 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:41,130 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:41,130 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6114557edd3e2be4679297c99dbb707, ASSIGN 2023-07-11 18:07:41,130 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34ae1cb300031e6413911b11bb3c0613, ASSIGN 2023-07-11 18:07:41,130 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=12ffd9ba99aec19d05a9a4bdc190df5e, ASSIGN 2023-07-11 18:07:41,130 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=082ae0e1538d0ea4afa6018633714d86, ASSIGN 2023-07-11 18:07:41,131 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fd79949daf97fb71187ed6ccb826c85, ASSIGN 2023-07-11 18:07:41,131 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c41300b446f1c31843a2ac322189ac5c, ASSIGN 2023-07-11 18:07:41,131 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ca21663676d98522661b9a7b1a038300, ASSIGN 2023-07-11 18:07:41,131 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8360d53793b402665c7d088b5757078c, ASSIGN 2023-07-11 18:07:41,131 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e32425e5b5ae93a85c8ed8a3e29ad2a, ASSIGN 2023-07-11 18:07:41,131 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=78, ppid=75, state=SUCCESS; OpenRegionProcedure ca21663676d98522661b9a7b1a038300, server=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:41,131 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=79, ppid=72, state=SUCCESS; OpenRegionProcedure 082ae0e1538d0ea4afa6018633714d86, server=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:41,131 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=80, ppid=71, state=SUCCESS; OpenRegionProcedure 12ffd9ba99aec19d05a9a4bdc190df5e, server=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:41,131 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=81, ppid=74, state=SUCCESS; OpenRegionProcedure c41300b446f1c31843a2ac322189ac5c, server=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:41,131 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=82, ppid=70, state=SUCCESS; OpenRegionProcedure 34ae1cb300031e6413911b11bb3c0613, server=jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=83, ppid=76, state=SUCCESS; OpenRegionProcedure 8360d53793b402665c7d088b5757078c, server=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=84, ppid=77, state=SUCCESS; OpenRegionProcedure 9e32425e5b5ae93a85c8ed8a3e29ad2a, server=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=85, ppid=73, state=SUCCESS; OpenRegionProcedure 6fd79949daf97fb71187ed6ccb826c85, server=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.ProcedureExecutor(468): Loading pid=86, ppid=69, state=SUCCESS; OpenRegionProcedure e6114557edd3e2be4679297c99dbb707, server=jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.meta.1689098708882.meta, worker=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38785%2C1689098706958.1689098708736, worker=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=e6114557edd3e2be4679297c99dbb707, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=34ae1cb300031e6413911b11bb3c0613, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,133 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=12ffd9ba99aec19d05a9a4bdc190df5e, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=082ae0e1538d0ea4afa6018633714d86, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6fd79949daf97fb71187ed6ccb826c85, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=c41300b446f1c31843a2ac322189ac5c, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ca21663676d98522661b9a7b1a038300, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=8360d53793b402665c7d088b5757078c, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=9e32425e5b5ae93a85c8ed8a3e29ad2a, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=78, ppid=75, state=SUCCESS; OpenRegionProcedure ca21663676d98522661b9a7b1a038300, server=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=79, ppid=72, state=SUCCESS; OpenRegionProcedure 082ae0e1538d0ea4afa6018633714d86, server=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=80, ppid=71, state=SUCCESS; OpenRegionProcedure 12ffd9ba99aec19d05a9a4bdc190df5e, server=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=81, ppid=74, state=SUCCESS; OpenRegionProcedure c41300b446f1c31843a2ac322189ac5c, server=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=82, ppid=70, state=SUCCESS; OpenRegionProcedure 34ae1cb300031e6413911b11bb3c0613, server=jenkins-hbase9.apache.org,36619,1689098707062 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=83, ppid=76, state=SUCCESS; OpenRegionProcedure 8360d53793b402665c7d088b5757078c, server=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=84, ppid=77, state=SUCCESS; OpenRegionProcedure 9e32425e5b5ae93a85c8ed8a3e29ad2a, server=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=85, ppid=73, state=SUCCESS; OpenRegionProcedure 6fd79949daf97fb71187ed6ccb826c85, server=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 DEBUG [Listener at localhost/46025] procedure2.Procedure(946): pid=86, ppid=69, state=SUCCESS; OpenRegionProcedure e6114557edd3e2be4679297c99dbb707, server=jenkins-hbase9.apache.org,33801,1689098707010 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 18:07:41,134 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 10 msec 2023-07-11 18:07:41,135 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 18:07:41,136 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,33801,1689098707010, table=hbase:meta, region=1588230740 2023-07-11 18:07:41,136 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689098891136 2023-07-11 18:07:41,137 DEBUG [PEWorker-1] master.DeadServer(103): Processing jenkins-hbase9.apache.org,38785,1689098706958; numProcessing=1 2023-07-11 18:07:41,137 DEBUG [Listener at localhost/46025] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:07:41,143 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca21663676d98522661b9a7b1a038300, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=6 2023-07-11 18:07:41,143 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=e6114557edd3e2be4679297c99dbb707, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=5 2023-07-11 18:07:41,143 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cfeeac3165a77206892059eaf409a93a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:41,143 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=68a671ac00030280ed3c9b59840a157c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:41,143 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66c52954a1e65ac4eea3ad65ab781210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:41,143 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=34ae1cb300031e6413911b11bb3c0613, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=5 2023-07-11 18:07:41,144 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=a535c854541161846ee0519898cadf3f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:41,144 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1e821bd6d21478c1aef93851d0f84803, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:41,144 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=6fd79949daf97fb71187ed6ccb826c85, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=5 2023-07-11 18:07:41,144 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=ca97340b0ab43753a8263ae334c5b475, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:41,144 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9d068f7fd612d2e21c191a1d38a29723, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:41,144 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c41300b446f1c31843a2ac322189ac5c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=5 2023-07-11 18:07:41,144 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=01c403825db7c339c13e2f1101543b42, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:41,144 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=c07a104cc172022c4212e2e7a10199ba, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:41,145 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=1851532129addae5c0e78c4af9fe4b41, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:41,145 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9e32425e5b5ae93a85c8ed8a3e29ad2a, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=5 2023-07-11 18:07:41,145 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=697385c0414f8f3b285f33f1ce166651, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:41,145 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3a49a7d0f0c324e9e04b887b069379ae, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:41,145 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=12ffd9ba99aec19d05a9a4bdc190df5e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=5 2023-07-11 18:07:41,145 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=3fda35ffdbf54a7596d1f6e9dd4c3a45, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:41,145 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=cc5337c98b33958209dee082b9968414, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:41,145 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=8360d53793b402665c7d088b5757078c, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=5 2023-07-11 18:07:41,146 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=66f3e358060a5746d9b9f7c8e30affd1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:41,146 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=082ae0e1538d0ea4afa6018633714d86, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=5 2023-07-11 18:07:41,146 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f4618a109b5b547019676f2a63009dd7, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:41,146 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=9dd9757b1ce8f958386c6599a273f3ee, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33801,1689098707010, regionLocation=jenkins-hbase9.apache.org,33801,1689098707010, openSeqNum=2 2023-07-11 18:07:41,146 DEBUG [Listener at localhost/46025] assignment.RegionStateStore(147): Load hbase:meta entry region=f32630ccb5e2306ee100dad5b0bd664e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36619,1689098707062, regionLocation=jenkins-hbase9.apache.org,36619,1689098707062, openSeqNum=2 2023-07-11 18:07:41,146 INFO [Listener at localhost/46025] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 18:07:41,146 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689098921146 2023-07-11 18:07:41,146 INFO [Listener at localhost/46025] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689098981146 2023-07-11 18:07:41,146 INFO [Listener at localhost/46025] assignment.AssignmentManager(1536): Joined the cluster in 9 msec 2023-07-11 18:07:41,147 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase9.apache.org,38785,1689098706958 after splitting done 2023-07-11 18:07:41,147 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase9.apache.org,38785,1689098706958 from processing; numProcessing=0 2023-07-11 18:07:41,147 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 18:07:41,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; ServerCrashProcedure jenkins-hbase9.apache.org,38785,1689098706958, splitWal=true, meta=true in 2 mins, 27.871 sec 2023-07-11 18:07:41,401 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 18:07:41,408 WARN [RPCClient-NioEventLoopGroup-6-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38785 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:716) at org.apache.hbase.thirdparty.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:07:41,411 DEBUG [RPCClient-NioEventLoopGroup-6-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38785 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38785 2023-07-11 18:07:41,511 DEBUG [hconnection-0x2e8c0f62-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:07:41,619 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:07:41,638 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 18:07:41,641 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:07:41,648 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 18:07:41,655 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 18:07:41,661 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 18:07:41,661 DEBUG [hconnection-0x2e8c0f62-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:07:41,777 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 18:07:41,783 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 18:07:41,788 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 18:07:41,789 DEBUG [hconnection-0x2e8c0f62-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:07:41,903 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 18:07:41,909 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 18:07:41,914 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 18:07:41,914 DEBUG [hconnection-0x2e8c0f62-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:07:42,029 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 18:07:42,033 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 18:07:42,037 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 18:07:42,040 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 18:07:42,040 DEBUG [hconnection-0x2e8c0f62-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:07:42,151 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 18:07:42,154 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 18:07:42,158 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 18:07:42,158 DEBUG [hconnection-0x2e8c0f62-shared-pool-11] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:07:42,267 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 18:07:42,269 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 18:07:42,272 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 18:07:42,272 DEBUG [hconnection-0x2e8c0f62-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:07:42,381 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 18:07:42,383 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 18:07:42,383 DEBUG [hconnection-0x2e8c0f62-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38785 this server is in the failed servers list 2023-07-11 18:07:42,493 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 18:07:42,496 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 18:07:42,500 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 18:07:42,508 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 18:07:42,513 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 18:07:42,517 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 18:07:42,521 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 18:07:42,525 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 18:07:42,529 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 18:07:42,533 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 18:07:42,537 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 18:07:42,540 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 18:07:42,544 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 18:07:42,548 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 18:07:42,551 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 18:07:42,555 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 18:07:42,558 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 18:07:42,562 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 18:07:42,566 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 18:07:42,570 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 18:07:42,573 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 18:07:42,577 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 18:07:42,580 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 18:07:42,584 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 18:07:42,587 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 18:07:42,591 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 18:07:42,594 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 18:07:42,598 DEBUG [Listener at localhost/46025] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 18:07:42,602 WARN [Listener at localhost/46025] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-11 18:07:42,602 INFO [Listener at localhost/46025] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 18:07:42,602 INFO [Listener at localhost/46025] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 18:07:42,603 DEBUG [Listener at localhost/46025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16ae3423 to 127.0.0.1:56404 2023-07-11 18:07:42,603 DEBUG [Listener at localhost/46025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:07:42,603 DEBUG [Listener at localhost/46025] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 18:07:42,603 DEBUG [Listener at localhost/46025] util.JVMClusterUtil(257): Found active master hash=257596825, stopped=false 2023-07-11 18:07:42,604 INFO [Listener at localhost/46025] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,35481,1689098705729 2023-07-11 18:07:42,608 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 18:07:42,608 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 18:07:42,608 INFO [Listener at localhost/46025] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:07:42,608 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 18:07:42,609 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:07:42,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:07:42,611 DEBUG [Listener at localhost/46025] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2619c11d to 127.0.0.1:56404 2023-07-11 18:07:42,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:07:42,611 DEBUG [Listener at localhost/46025] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:07:42,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:07:42,612 INFO [Listener at localhost/46025] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,33801,1689098707010' ***** 2023-07-11 18:07:42,612 INFO [Listener at localhost/46025] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 18:07:42,612 INFO [Listener at localhost/46025] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,36619,1689098707062' ***** 2023-07-11 18:07:42,612 INFO [Listener at localhost/46025] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 18:07:42,612 INFO [RS:1;jenkins-hbase9:33801] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 18:07:42,612 INFO [RS:2;jenkins-hbase9:36619] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 18:07:42,612 INFO [RS:1;jenkins-hbase9:33801] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 18:07:42,612 INFO [RS:2;jenkins-hbase9:36619] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 18:07:42,612 INFO [RS:1;jenkins-hbase9:33801] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 18:07:42,612 INFO [RS:2;jenkins-hbase9:36619] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 18:07:42,612 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 18:07:42,612 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 18:07:42,613 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 3fda35ffdbf54a7596d1f6e9dd4c3a45 2023-07-11 18:07:42,615 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for 01c403825db7c339c13e2f1101543b42 2023-07-11 18:07:42,616 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:07:42,616 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:07:42,617 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for cfeeac3165a77206892059eaf409a93a 2023-07-11 18:07:42,617 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 9e32425e5b5ae93a85c8ed8a3e29ad2a 2023-07-11 18:07:42,617 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for 3a49a7d0f0c324e9e04b887b069379ae 2023-07-11 18:07:42,617 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for f4618a109b5b547019676f2a63009dd7 2023-07-11 18:07:42,617 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 66c52954a1e65ac4eea3ad65ab781210 2023-07-11 18:07:42,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 01c403825db7c339c13e2f1101543b42, disabling compactions & flushes 2023-07-11 18:07:42,618 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 697385c0414f8f3b285f33f1ce166651 2023-07-11 18:07:42,618 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for 1851532129addae5c0e78c4af9fe4b41 2023-07-11 18:07:42,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3fda35ffdbf54a7596d1f6e9dd4c3a45, disabling compactions & flushes 2023-07-11 18:07:42,618 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for c41300b446f1c31843a2ac322189ac5c 2023-07-11 18:07:42,618 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 66f3e358060a5746d9b9f7c8e30affd1 2023-07-11 18:07:42,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:07:42,618 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for c07a104cc172022c4212e2e7a10199ba 2023-07-11 18:07:42,618 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for a535c854541161846ee0519898cadf3f 2023-07-11 18:07:42,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:07:42,619 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:07:42,619 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 68a671ac00030280ed3c9b59840a157c 2023-07-11 18:07:42,619 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for 34ae1cb300031e6413911b11bb3c0613 2023-07-11 18:07:42,619 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 6fd79949daf97fb71187ed6ccb826c85 2023-07-11 18:07:42,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:07:42,619 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 1e821bd6d21478c1aef93851d0f84803 2023-07-11 18:07:42,619 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for 12ffd9ba99aec19d05a9a4bdc190df5e 2023-07-11 18:07:42,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:07:42,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. after waiting 0 ms 2023-07-11 18:07:42,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:07:42,619 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for ca97340b0ab43753a8263ae334c5b475 2023-07-11 18:07:42,619 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 9d068f7fd612d2e21c191a1d38a29723 2023-07-11 18:07:42,619 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for cc5337c98b33958209dee082b9968414 2023-07-11 18:07:42,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. after waiting 0 ms 2023-07-11 18:07:42,620 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for ca21663676d98522661b9a7b1a038300 2023-07-11 18:07:42,619 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:42,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 3fda35ffdbf54a7596d1f6e9dd4c3a45 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:42,620 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 8360d53793b402665c7d088b5757078c 2023-07-11 18:07:42,620 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(3305): Received CLOSE for 082ae0e1538d0ea4afa6018633714d86 2023-07-11 18:07:42,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:07:42,620 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:42,620 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 9dd9757b1ce8f958386c6599a273f3ee 2023-07-11 18:07:42,620 DEBUG [RS:2;jenkins-hbase9:36619] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d87e5ec to 127.0.0.1:56404 2023-07-11 18:07:42,620 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:42,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 01c403825db7c339c13e2f1101543b42 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:42,620 DEBUG [RS:1;jenkins-hbase9:33801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c9b813c to 127.0.0.1:56404 2023-07-11 18:07:42,620 DEBUG [RS:2;jenkins-hbase9:36619] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:07:42,620 DEBUG [RS:1;jenkins-hbase9:33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:07:42,621 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1474): Waiting on 14 regions to close 2023-07-11 18:07:42,622 INFO [RS:1;jenkins-hbase9:33801] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 18:07:42,622 INFO [RS:1;jenkins-hbase9:33801] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 18:07:42,622 INFO [RS:1;jenkins-hbase9:33801] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 18:07:42,622 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 18:07:42,622 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1474): Waiting on 14 regions to close 2023-07-11 18:07:42,626 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 18:07:42,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 18:07:42,626 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 18:07:42,626 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 18:07:42,626 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 18:07:42,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=13.02 KB heapSize=19.01 KB 2023-07-11 18:07:42,627 DEBUG [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1504): Waiting on 01c403825db7c339c13e2f1101543b42, 082ae0e1538d0ea4afa6018633714d86, 12ffd9ba99aec19d05a9a4bdc190df5e, 1851532129addae5c0e78c4af9fe4b41, 34ae1cb300031e6413911b11bb3c0613, 3a49a7d0f0c324e9e04b887b069379ae, a535c854541161846ee0519898cadf3f, c41300b446f1c31843a2ac322189ac5c, ca21663676d98522661b9a7b1a038300, ca97340b0ab43753a8263ae334c5b475, cc5337c98b33958209dee082b9968414, cfeeac3165a77206892059eaf409a93a, f32630ccb5e2306ee100dad5b0bd664e, f4618a109b5b547019676f2a63009dd7 2023-07-11 18:07:42,627 DEBUG [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1504): Waiting on 1588230740, 1e821bd6d21478c1aef93851d0f84803, 3fda35ffdbf54a7596d1f6e9dd4c3a45, 66c52954a1e65ac4eea3ad65ab781210, 66f3e358060a5746d9b9f7c8e30affd1, 68a671ac00030280ed3c9b59840a157c, 697385c0414f8f3b285f33f1ce166651, 6fd79949daf97fb71187ed6ccb826c85, 8360d53793b402665c7d088b5757078c, 9d068f7fd612d2e21c191a1d38a29723, 9dd9757b1ce8f958386c6599a273f3ee, 9e32425e5b5ae93a85c8ed8a3e29ad2a, c07a104cc172022c4212e2e7a10199ba, e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:42,676 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.02 KB at sequenceid=84 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/.tmp/info/5e577817ee5b4d7a99b8d886ca2fb4bf 2023-07-11 18:07:42,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/.tmp/colfamily11/88c876bf7574465ea2b0ba1518ab205c 2023-07-11 18:07:42,683 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/.tmp/info/5e577817ee5b4d7a99b8d886ca2fb4bf as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/info/5e577817ee5b4d7a99b8d886ca2fb4bf 2023-07-11 18:07:42,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/.tmp/colfamily11/88c876bf7574465ea2b0ba1518ab205c as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/colfamily11/88c876bf7574465ea2b0ba1518ab205c 2023-07-11 18:07:42,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/info/5e577817ee5b4d7a99b8d886ca2fb4bf, entries=72, sequenceid=84, filesize=18.0 K 2023-07-11 18:07:42,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~13.02 KB/13328, heapSize ~18.49 KB/18936, currentSize=0 B/0 for 1588230740 in 64ms, sequenceid=84, compaction requested=false 2023-07-11 18:07:42,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/colfamily11/88c876bf7574465ea2b0ba1518ab205c, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:42,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 01c403825db7c339c13e2f1101543b42 in 75ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:42,700 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/meta/1588230740/recovered.edits/87.seqid, newMaxSeqId=87, maxSeqId=63 2023-07-11 18:07:42,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 18:07:42,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/01c403825db7c339c13e2f1101543b42/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:42,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 18:07:42,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 18:07:42,702 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 18:07:42,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:07:42,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 01c403825db7c339c13e2f1101543b42: 2023-07-11 18:07:42,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689098710109.01c403825db7c339c13e2f1101543b42. 2023-07-11 18:07:42,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing cfeeac3165a77206892059eaf409a93a, disabling compactions & flushes 2023-07-11 18:07:42,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:07:42,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:07:42,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. after waiting 0 ms 2023-07-11 18:07:42,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:07:42,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing cfeeac3165a77206892059eaf409a93a 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:42,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/.tmp/colfamily11/a8a5389297214b56952270523637b202 2023-07-11 18:07:42,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/.tmp/colfamily11/a8a5389297214b56952270523637b202 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/colfamily11/a8a5389297214b56952270523637b202 2023-07-11 18:07:42,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/colfamily11/a8a5389297214b56952270523637b202, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:42,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for cfeeac3165a77206892059eaf409a93a in 26ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:42,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cfeeac3165a77206892059eaf409a93a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:42,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:07:42,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for cfeeac3165a77206892059eaf409a93a: 2023-07-11 18:07:42,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689098710109.cfeeac3165a77206892059eaf409a93a. 2023-07-11 18:07:42,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3a49a7d0f0c324e9e04b887b069379ae, disabling compactions & flushes 2023-07-11 18:07:42,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:07:42,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:07:42,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. after waiting 0 ms 2023-07-11 18:07:42,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:07:42,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 3a49a7d0f0c324e9e04b887b069379ae 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:42,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/.tmp/colfamily11/854f3e5c59a64343a86446f46047fbba 2023-07-11 18:07:42,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/.tmp/colfamily11/854f3e5c59a64343a86446f46047fbba as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/colfamily11/854f3e5c59a64343a86446f46047fbba 2023-07-11 18:07:42,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/colfamily11/854f3e5c59a64343a86446f46047fbba, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:42,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 3a49a7d0f0c324e9e04b887b069379ae in 40ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:42,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3a49a7d0f0c324e9e04b887b069379ae/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:42,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:07:42,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3a49a7d0f0c324e9e04b887b069379ae: 2023-07-11 18:07:42,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689098710109.3a49a7d0f0c324e9e04b887b069379ae. 2023-07-11 18:07:42,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f4618a109b5b547019676f2a63009dd7, disabling compactions & flushes 2023-07-11 18:07:42,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:07:42,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:07:42,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. after waiting 0 ms 2023-07-11 18:07:42,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:07:42,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing f4618a109b5b547019676f2a63009dd7 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:42,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/.tmp/colfamily11/6ca5bc99b69349bfb851b30c421c0b0a 2023-07-11 18:07:42,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/.tmp/colfamily11/6ca5bc99b69349bfb851b30c421c0b0a as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/colfamily11/6ca5bc99b69349bfb851b30c421c0b0a 2023-07-11 18:07:42,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/colfamily11/6ca5bc99b69349bfb851b30c421c0b0a, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:42,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for f4618a109b5b547019676f2a63009dd7 in 27ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:42,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f4618a109b5b547019676f2a63009dd7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:42,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:07:42,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f4618a109b5b547019676f2a63009dd7: 2023-07-11 18:07:42,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689098710109.f4618a109b5b547019676f2a63009dd7. 2023-07-11 18:07:42,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1851532129addae5c0e78c4af9fe4b41, disabling compactions & flushes 2023-07-11 18:07:42,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:07:42,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:07:42,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. after waiting 0 ms 2023-07-11 18:07:42,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:07:42,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1851532129addae5c0e78c4af9fe4b41 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:42,827 DEBUG [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1504): Waiting on 082ae0e1538d0ea4afa6018633714d86, 12ffd9ba99aec19d05a9a4bdc190df5e, 1851532129addae5c0e78c4af9fe4b41, 34ae1cb300031e6413911b11bb3c0613, a535c854541161846ee0519898cadf3f, c41300b446f1c31843a2ac322189ac5c, ca21663676d98522661b9a7b1a038300, ca97340b0ab43753a8263ae334c5b475, cc5337c98b33958209dee082b9968414, f32630ccb5e2306ee100dad5b0bd664e 2023-07-11 18:07:42,827 DEBUG [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1504): Waiting on 1e821bd6d21478c1aef93851d0f84803, 3fda35ffdbf54a7596d1f6e9dd4c3a45, 66c52954a1e65ac4eea3ad65ab781210, 66f3e358060a5746d9b9f7c8e30affd1, 68a671ac00030280ed3c9b59840a157c, 697385c0414f8f3b285f33f1ce166651, 6fd79949daf97fb71187ed6ccb826c85, 8360d53793b402665c7d088b5757078c, 9d068f7fd612d2e21c191a1d38a29723, 9dd9757b1ce8f958386c6599a273f3ee, 9e32425e5b5ae93a85c8ed8a3e29ad2a, c07a104cc172022c4212e2e7a10199ba, e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:42,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/.tmp/colfamily11/30273686ad1f4baf841f16e966df16ce 2023-07-11 18:07:42,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/.tmp/colfamily11/30273686ad1f4baf841f16e966df16ce as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/colfamily11/30273686ad1f4baf841f16e966df16ce 2023-07-11 18:07:42,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/colfamily11/30273686ad1f4baf841f16e966df16ce, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:42,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 1851532129addae5c0e78c4af9fe4b41 in 30ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:42,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1851532129addae5c0e78c4af9fe4b41/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:42,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:07:42,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1851532129addae5c0e78c4af9fe4b41: 2023-07-11 18:07:42,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689098710109.1851532129addae5c0e78c4af9fe4b41. 2023-07-11 18:07:42,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c41300b446f1c31843a2ac322189ac5c, disabling compactions & flushes 2023-07-11 18:07:42,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:07:42,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:07:42,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. after waiting 0 ms 2023-07-11 18:07:42,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:07:42,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c41300b446f1c31843a2ac322189ac5c/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 18:07:42,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:07:42,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c41300b446f1c31843a2ac322189ac5c: 2023-07-11 18:07:42,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689098710109.c41300b446f1c31843a2ac322189ac5c. 2023-07-11 18:07:42,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a535c854541161846ee0519898cadf3f, disabling compactions & flushes 2023-07-11 18:07:42,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:07:42,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:07:42,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. after waiting 0 ms 2023-07-11 18:07:42,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:07:42,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing a535c854541161846ee0519898cadf3f 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:42,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/.tmp/colfamily11/5b69fed017bf43da80dafeaba6f665be 2023-07-11 18:07:42,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/.tmp/colfamily11/5b69fed017bf43da80dafeaba6f665be as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/colfamily11/5b69fed017bf43da80dafeaba6f665be 2023-07-11 18:07:42,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/colfamily11/5b69fed017bf43da80dafeaba6f665be, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:42,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for a535c854541161846ee0519898cadf3f in 29ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:42,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a535c854541161846ee0519898cadf3f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:42,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:07:42,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a535c854541161846ee0519898cadf3f: 2023-07-11 18:07:42,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689098710109.a535c854541161846ee0519898cadf3f. 2023-07-11 18:07:42,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f32630ccb5e2306ee100dad5b0bd664e, disabling compactions & flushes 2023-07-11 18:07:42,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:07:42,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:07:42,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. after waiting 0 ms 2023-07-11 18:07:42,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:07:42,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing f32630ccb5e2306ee100dad5b0bd664e 3/3 column families, dataSize=48 B heapSize=888 B 2023-07-11 18:07:42,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48 B at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/.tmp/colfamily11/aac243d968e44aaaa7fcf7373b9e40f3 2023-07-11 18:07:42,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/.tmp/colfamily11/aac243d968e44aaaa7fcf7373b9e40f3 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/colfamily11/aac243d968e44aaaa7fcf7373b9e40f3 2023-07-11 18:07:42,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/colfamily11/aac243d968e44aaaa7fcf7373b9e40f3, entries=1, sequenceid=5, filesize=4.6 K 2023-07-11 18:07:42,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for f32630ccb5e2306ee100dad5b0bd664e in 36ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:42,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/f32630ccb5e2306ee100dad5b0bd664e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:42,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:07:42,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f32630ccb5e2306ee100dad5b0bd664e: 2023-07-11 18:07:42,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689098710109.f32630ccb5e2306ee100dad5b0bd664e. 2023-07-11 18:07:42,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 34ae1cb300031e6413911b11bb3c0613, disabling compactions & flushes 2023-07-11 18:07:42,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:07:42,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:07:42,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. after waiting 0 ms 2023-07-11 18:07:42,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:07:42,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/34ae1cb300031e6413911b11bb3c0613/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 18:07:42,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:07:42,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 34ae1cb300031e6413911b11bb3c0613: 2023-07-11 18:07:42,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689098710109.34ae1cb300031e6413911b11bb3c0613. 2023-07-11 18:07:42,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 12ffd9ba99aec19d05a9a4bdc190df5e, disabling compactions & flushes 2023-07-11 18:07:42,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:07:42,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:07:42,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. after waiting 0 ms 2023-07-11 18:07:42,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:07:42,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/12ffd9ba99aec19d05a9a4bdc190df5e/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 18:07:42,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:07:42,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 12ffd9ba99aec19d05a9a4bdc190df5e: 2023-07-11 18:07:42,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689098710109.12ffd9ba99aec19d05a9a4bdc190df5e. 2023-07-11 18:07:42,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ca97340b0ab43753a8263ae334c5b475, disabling compactions & flushes 2023-07-11 18:07:42,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:07:42,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:07:42,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. after waiting 0 ms 2023-07-11 18:07:42,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:07:42,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ca97340b0ab43753a8263ae334c5b475 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:42,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/.tmp/colfamily11/a52b0b290a554472a5ffdec696c2ec73 2023-07-11 18:07:42,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/.tmp/colfamily11/a52b0b290a554472a5ffdec696c2ec73 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/colfamily11/a52b0b290a554472a5ffdec696c2ec73 2023-07-11 18:07:42,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/colfamily11/a52b0b290a554472a5ffdec696c2ec73, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:42,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ca97340b0ab43753a8263ae334c5b475 in 27ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:42,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ca97340b0ab43753a8263ae334c5b475/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:42,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:07:42,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ca97340b0ab43753a8263ae334c5b475: 2023-07-11 18:07:42,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689098710109.ca97340b0ab43753a8263ae334c5b475. 2023-07-11 18:07:42,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing cc5337c98b33958209dee082b9968414, disabling compactions & flushes 2023-07-11 18:07:42,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:07:42,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:07:42,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. after waiting 0 ms 2023-07-11 18:07:42,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:07:42,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing cc5337c98b33958209dee082b9968414 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:43,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/.tmp/colfamily11/34f9c3d57e4a412f88f2382c7afa1b86 2023-07-11 18:07:43,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/.tmp/colfamily11/34f9c3d57e4a412f88f2382c7afa1b86 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/colfamily11/34f9c3d57e4a412f88f2382c7afa1b86 2023-07-11 18:07:43,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/colfamily11/34f9c3d57e4a412f88f2382c7afa1b86, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:43,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for cc5337c98b33958209dee082b9968414 in 28ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:43,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/cc5337c98b33958209dee082b9968414/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:43,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:07:43,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for cc5337c98b33958209dee082b9968414: 2023-07-11 18:07:43,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689098710109.cc5337c98b33958209dee082b9968414. 2023-07-11 18:07:43,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ca21663676d98522661b9a7b1a038300, disabling compactions & flushes 2023-07-11 18:07:43,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:07:43,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:07:43,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. after waiting 0 ms 2023-07-11 18:07:43,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:07:43,027 DEBUG [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1504): Waiting on 082ae0e1538d0ea4afa6018633714d86, ca21663676d98522661b9a7b1a038300 2023-07-11 18:07:43,027 DEBUG [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1504): Waiting on 1e821bd6d21478c1aef93851d0f84803, 3fda35ffdbf54a7596d1f6e9dd4c3a45, 66c52954a1e65ac4eea3ad65ab781210, 66f3e358060a5746d9b9f7c8e30affd1, 68a671ac00030280ed3c9b59840a157c, 697385c0414f8f3b285f33f1ce166651, 6fd79949daf97fb71187ed6ccb826c85, 8360d53793b402665c7d088b5757078c, 9d068f7fd612d2e21c191a1d38a29723, 9dd9757b1ce8f958386c6599a273f3ee, 9e32425e5b5ae93a85c8ed8a3e29ad2a, c07a104cc172022c4212e2e7a10199ba, e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:43,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/hbase/namespace/ca21663676d98522661b9a7b1a038300/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=5 2023-07-11 18:07:43,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:07:43,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ca21663676d98522661b9a7b1a038300: 2023-07-11 18:07:43,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689098709209.ca21663676d98522661b9a7b1a038300. 2023-07-11 18:07:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 082ae0e1538d0ea4afa6018633714d86, disabling compactions & flushes 2023-07-11 18:07:43,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:07:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:07:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. after waiting 0 ms 2023-07-11 18:07:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:07:43,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/082ae0e1538d0ea4afa6018633714d86/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 18:07:43,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:07:43,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 082ae0e1538d0ea4afa6018633714d86: 2023-07-11 18:07:43,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689098710109.082ae0e1538d0ea4afa6018633714d86. 2023-07-11 18:07:43,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/.tmp/colfamily11/8cf0890784514346abb7528d765356f5 2023-07-11 18:07:43,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/.tmp/colfamily11/8cf0890784514346abb7528d765356f5 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/colfamily11/8cf0890784514346abb7528d765356f5 2023-07-11 18:07:43,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/colfamily11/8cf0890784514346abb7528d765356f5, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:43,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 3fda35ffdbf54a7596d1f6e9dd4c3a45 in 474ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:43,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/3fda35ffdbf54a7596d1f6e9dd4c3a45/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:43,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:07:43,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3fda35ffdbf54a7596d1f6e9dd4c3a45: 2023-07-11 18:07:43,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689098710109.3fda35ffdbf54a7596d1f6e9dd4c3a45. 2023-07-11 18:07:43,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9e32425e5b5ae93a85c8ed8a3e29ad2a, disabling compactions & flushes 2023-07-11 18:07:43,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:07:43,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:07:43,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. after waiting 0 ms 2023-07-11 18:07:43,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:07:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9e32425e5b5ae93a85c8ed8a3e29ad2a/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 18:07:43,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:07:43,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9e32425e5b5ae93a85c8ed8a3e29ad2a: 2023-07-11 18:07:43,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689098710109.9e32425e5b5ae93a85c8ed8a3e29ad2a. 2023-07-11 18:07:43,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 66c52954a1e65ac4eea3ad65ab781210, disabling compactions & flushes 2023-07-11 18:07:43,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:07:43,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:07:43,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. after waiting 0 ms 2023-07-11 18:07:43,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:07:43,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 66c52954a1e65ac4eea3ad65ab781210 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:43,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/.tmp/colfamily11/f2816f6a6bc84c59962a908f82fe2979 2023-07-11 18:07:43,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/.tmp/colfamily11/f2816f6a6bc84c59962a908f82fe2979 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/colfamily11/f2816f6a6bc84c59962a908f82fe2979 2023-07-11 18:07:43,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/colfamily11/f2816f6a6bc84c59962a908f82fe2979, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:43,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 66c52954a1e65ac4eea3ad65ab781210 in 28ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:43,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66c52954a1e65ac4eea3ad65ab781210/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:43,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:07:43,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 66c52954a1e65ac4eea3ad65ab781210: 2023-07-11 18:07:43,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689098710109.66c52954a1e65ac4eea3ad65ab781210. 2023-07-11 18:07:43,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 697385c0414f8f3b285f33f1ce166651, disabling compactions & flushes 2023-07-11 18:07:43,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:07:43,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:07:43,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. after waiting 0 ms 2023-07-11 18:07:43,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:07:43,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 697385c0414f8f3b285f33f1ce166651 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:43,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/.tmp/colfamily11/8a96b3157bf74e01a2a36e0c56a160e3 2023-07-11 18:07:43,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/.tmp/colfamily11/8a96b3157bf74e01a2a36e0c56a160e3 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/colfamily11/8a96b3157bf74e01a2a36e0c56a160e3 2023-07-11 18:07:43,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/colfamily11/8a96b3157bf74e01a2a36e0c56a160e3, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:43,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 697385c0414f8f3b285f33f1ce166651 in 25ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:43,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/697385c0414f8f3b285f33f1ce166651/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:43,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:07:43,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 697385c0414f8f3b285f33f1ce166651: 2023-07-11 18:07:43,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689098710109.697385c0414f8f3b285f33f1ce166651. 2023-07-11 18:07:43,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 66f3e358060a5746d9b9f7c8e30affd1, disabling compactions & flushes 2023-07-11 18:07:43,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:07:43,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:07:43,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. after waiting 0 ms 2023-07-11 18:07:43,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:07:43,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 66f3e358060a5746d9b9f7c8e30affd1 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:43,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/.tmp/colfamily11/f8731fd1a60b446392b9f02a289435a1 2023-07-11 18:07:43,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/.tmp/colfamily11/f8731fd1a60b446392b9f02a289435a1 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/colfamily11/f8731fd1a60b446392b9f02a289435a1 2023-07-11 18:07:43,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/colfamily11/f8731fd1a60b446392b9f02a289435a1, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:43,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 66f3e358060a5746d9b9f7c8e30affd1 in 27ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:43,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66f3e358060a5746d9b9f7c8e30affd1/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:43,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:07:43,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 66f3e358060a5746d9b9f7c8e30affd1: 2023-07-11 18:07:43,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689098710109.66f3e358060a5746d9b9f7c8e30affd1. 2023-07-11 18:07:43,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c07a104cc172022c4212e2e7a10199ba, disabling compactions & flushes 2023-07-11 18:07:43,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:07:43,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:07:43,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. after waiting 0 ms 2023-07-11 18:07:43,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:07:43,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing c07a104cc172022c4212e2e7a10199ba 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:43,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/.tmp/colfamily11/d0177381843244f9a97e66656f51e263 2023-07-11 18:07:43,227 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,36619,1689098707062; all regions closed. 2023-07-11 18:07:43,227 DEBUG [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1504): Waiting on 1e821bd6d21478c1aef93851d0f84803, 68a671ac00030280ed3c9b59840a157c, 6fd79949daf97fb71187ed6ccb826c85, 8360d53793b402665c7d088b5757078c, 9d068f7fd612d2e21c191a1d38a29723, 9dd9757b1ce8f958386c6599a273f3ee, c07a104cc172022c4212e2e7a10199ba, e6114557edd3e2be4679297c99dbb707 2023-07-11 18:07:43,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/.tmp/colfamily11/d0177381843244f9a97e66656f51e263 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/colfamily11/d0177381843244f9a97e66656f51e263 2023-07-11 18:07:43,234 DEBUG [RS:2;jenkins-hbase9:36619] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/oldWALs 2023-07-11 18:07:43,234 INFO [RS:2;jenkins-hbase9:36619] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C36619%2C1689098707062:(num 1689098708737) 2023-07-11 18:07:43,234 DEBUG [RS:2;jenkins-hbase9:36619] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:07:43,235 INFO [RS:2;jenkins-hbase9:36619] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:07:43,235 INFO [RS:2;jenkins-hbase9:36619] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 18:07:43,235 INFO [RS:2;jenkins-hbase9:36619] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 18:07:43,235 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 18:07:43,235 INFO [RS:2;jenkins-hbase9:36619] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 18:07:43,235 INFO [RS:2;jenkins-hbase9:36619] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 18:07:43,236 INFO [RS:2;jenkins-hbase9:36619] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:36619 2023-07-11 18:07:43,241 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:07:43,241 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:43,241 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,36619,1689098707062 2023-07-11 18:07:43,241 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:07:43,241 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:07:43,244 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,36619,1689098707062] 2023-07-11 18:07:43,244 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,36619,1689098707062; numProcessing=1 2023-07-11 18:07:43,246 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,36619,1689098707062 already deleted, retry=false 2023-07-11 18:07:43,246 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,36619,1689098707062 expired; onlineServers=1 2023-07-11 18:07:43,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/colfamily11/d0177381843244f9a97e66656f51e263, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:43,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for c07a104cc172022c4212e2e7a10199ba in 35ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:43,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/c07a104cc172022c4212e2e7a10199ba/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:43,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:07:43,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c07a104cc172022c4212e2e7a10199ba: 2023-07-11 18:07:43,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689098710109.c07a104cc172022c4212e2e7a10199ba. 2023-07-11 18:07:43,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 68a671ac00030280ed3c9b59840a157c, disabling compactions & flushes 2023-07-11 18:07:43,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:07:43,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:07:43,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. after waiting 0 ms 2023-07-11 18:07:43,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:07:43,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 68a671ac00030280ed3c9b59840a157c 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:43,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/.tmp/colfamily11/8b38234999614a0091c1c94b3d43dadb 2023-07-11 18:07:43,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/.tmp/colfamily11/8b38234999614a0091c1c94b3d43dadb as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/colfamily11/8b38234999614a0091c1c94b3d43dadb 2023-07-11 18:07:43,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/colfamily11/8b38234999614a0091c1c94b3d43dadb, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:43,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 68a671ac00030280ed3c9b59840a157c in 26ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:43,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/68a671ac00030280ed3c9b59840a157c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:43,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:07:43,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 68a671ac00030280ed3c9b59840a157c: 2023-07-11 18:07:43,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689098710109.68a671ac00030280ed3c9b59840a157c. 2023-07-11 18:07:43,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 6fd79949daf97fb71187ed6ccb826c85, disabling compactions & flushes 2023-07-11 18:07:43,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:07:43,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:07:43,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. after waiting 0 ms 2023-07-11 18:07:43,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:07:43,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6fd79949daf97fb71187ed6ccb826c85/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 18:07:43,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:07:43,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 6fd79949daf97fb71187ed6ccb826c85: 2023-07-11 18:07:43,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689098710109.6fd79949daf97fb71187ed6ccb826c85. 2023-07-11 18:07:43,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1e821bd6d21478c1aef93851d0f84803, disabling compactions & flushes 2023-07-11 18:07:43,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:07:43,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:07:43,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. after waiting 0 ms 2023-07-11 18:07:43,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:07:43,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1e821bd6d21478c1aef93851d0f84803 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:43,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/.tmp/colfamily11/d73e0e4b94914dd5b3e09b48c911b8b7 2023-07-11 18:07:43,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/.tmp/colfamily11/d73e0e4b94914dd5b3e09b48c911b8b7 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/colfamily11/d73e0e4b94914dd5b3e09b48c911b8b7 2023-07-11 18:07:43,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/colfamily11/d73e0e4b94914dd5b3e09b48c911b8b7, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:43,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 1e821bd6d21478c1aef93851d0f84803 in 25ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:43,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/1e821bd6d21478c1aef93851d0f84803/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:43,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:07:43,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1e821bd6d21478c1aef93851d0f84803: 2023-07-11 18:07:43,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689098710109.1e821bd6d21478c1aef93851d0f84803. 2023-07-11 18:07:43,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9d068f7fd612d2e21c191a1d38a29723, disabling compactions & flushes 2023-07-11 18:07:43,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:07:43,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:07:43,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. after waiting 0 ms 2023-07-11 18:07:43,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:07:43,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 9d068f7fd612d2e21c191a1d38a29723 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:43,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/.tmp/colfamily11/324d315212cf4829bb814052822adb57 2023-07-11 18:07:43,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/.tmp/colfamily11/324d315212cf4829bb814052822adb57 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/colfamily11/324d315212cf4829bb814052822adb57 2023-07-11 18:07:43,345 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:07:43,345 INFO [RS:2;jenkins-hbase9:36619] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,36619,1689098707062; zookeeper connection closed. 2023-07-11 18:07:43,345 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:36619-0x10155819b8c0003, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:07:43,346 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@324f94e2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@324f94e2 2023-07-11 18:07:43,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/colfamily11/324d315212cf4829bb814052822adb57, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:43,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 9d068f7fd612d2e21c191a1d38a29723 in 29ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:43,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9d068f7fd612d2e21c191a1d38a29723/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:43,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:07:43,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9d068f7fd612d2e21c191a1d38a29723: 2023-07-11 18:07:43,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689098710109.9d068f7fd612d2e21c191a1d38a29723. 2023-07-11 18:07:43,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e6114557edd3e2be4679297c99dbb707, disabling compactions & flushes 2023-07-11 18:07:43,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:07:43,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:07:43,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. after waiting 0 ms 2023-07-11 18:07:43,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:07:43,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/e6114557edd3e2be4679297c99dbb707/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 18:07:43,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:07:43,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e6114557edd3e2be4679297c99dbb707: 2023-07-11 18:07:43,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689098710109.e6114557edd3e2be4679297c99dbb707. 2023-07-11 18:07:43,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8360d53793b402665c7d088b5757078c, disabling compactions & flushes 2023-07-11 18:07:43,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:07:43,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:07:43,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. after waiting 0 ms 2023-07-11 18:07:43,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:07:43,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/8360d53793b402665c7d088b5757078c/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 18:07:43,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:07:43,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8360d53793b402665c7d088b5757078c: 2023-07-11 18:07:43,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689098710109.8360d53793b402665c7d088b5757078c. 2023-07-11 18:07:43,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9dd9757b1ce8f958386c6599a273f3ee, disabling compactions & flushes 2023-07-11 18:07:43,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:07:43,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:07:43,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. after waiting 0 ms 2023-07-11 18:07:43,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:07:43,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 9dd9757b1ce8f958386c6599a273f3ee 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 18:07:43,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/.tmp/colfamily11/7311089a2a434aa2b96e0fa165f39198 2023-07-11 18:07:43,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/.tmp/colfamily11/7311089a2a434aa2b96e0fa165f39198 as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/colfamily11/7311089a2a434aa2b96e0fa165f39198 2023-07-11 18:07:43,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/colfamily11/7311089a2a434aa2b96e0fa165f39198, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 18:07:43,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 9dd9757b1ce8f958386c6599a273f3ee in 28ms, sequenceid=5, compaction requested=false 2023-07-11 18:07:43,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/9dd9757b1ce8f958386c6599a273f3ee/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:07:43,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:07:43,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9dd9757b1ce8f958386c6599a273f3ee: 2023-07-11 18:07:43,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689098710109.9dd9757b1ce8f958386c6599a273f3ee. 2023-07-11 18:07:43,428 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,33801,1689098707010; all regions closed. 2023-07-11 18:07:43,433 DEBUG [RS:1;jenkins-hbase9:33801] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/oldWALs 2023-07-11 18:07:43,434 INFO [RS:1;jenkins-hbase9:33801] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C33801%2C1689098707010.meta:.meta(num 1689098858680) 2023-07-11 18:07:43,439 DEBUG [RS:1;jenkins-hbase9:33801] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/oldWALs 2023-07-11 18:07:43,439 INFO [RS:1;jenkins-hbase9:33801] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C33801%2C1689098707010:(num 1689098708737) 2023-07-11 18:07:43,439 DEBUG [RS:1;jenkins-hbase9:33801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:07:43,439 INFO [RS:1;jenkins-hbase9:33801] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:07:43,439 INFO [RS:1;jenkins-hbase9:33801] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 18:07:43,440 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 18:07:43,440 INFO [RS:1;jenkins-hbase9:33801] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:33801 2023-07-11 18:07:43,444 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33801,1689098707010 2023-07-11 18:07:43,444 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:07:43,445 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,33801,1689098707010] 2023-07-11 18:07:43,445 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,33801,1689098707010; numProcessing=2 2023-07-11 18:07:43,447 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,33801,1689098707010 already deleted, retry=false 2023-07-11 18:07:43,447 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,33801,1689098707010 expired; onlineServers=0 2023-07-11 18:07:43,447 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,35481,1689098705729' ***** 2023-07-11 18:07:43,447 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 18:07:43,447 DEBUG [M:0;jenkins-hbase9:35481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e6797a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 18:07:43,447 INFO [M:0;jenkins-hbase9:35481] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,35481,1689098705729 2023-07-11 18:07:43,447 INFO [M:0;jenkins-hbase9:35481] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,35481,1689098705729; all regions closed. 2023-07-11 18:07:43,447 DEBUG [M:0;jenkins-hbase9:35481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:07:43,448 DEBUG [M:0;jenkins-hbase9:35481] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 18:07:43,448 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 18:07:43,448 DEBUG [M:0;jenkins-hbase9:35481] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 18:07:43,448 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689098708303] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689098708303,5,FailOnTimeoutGroup] 2023-07-11 18:07:43,448 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689098708304] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689098708304,5,FailOnTimeoutGroup] 2023-07-11 18:07:43,449 INFO [M:0;jenkins-hbase9:35481] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 18:07:43,449 INFO [M:0;jenkins-hbase9:35481] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 18:07:43,449 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 18:07:43,449 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:07:43,449 INFO [M:0;jenkins-hbase9:35481] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-11 18:07:43,450 DEBUG [M:0;jenkins-hbase9:35481] master.HMaster(1512): Stopping service threads 2023-07-11 18:07:43,450 INFO [M:0;jenkins-hbase9:35481] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 18:07:43,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:07:43,450 ERROR [M:0;jenkins-hbase9:35481] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 18:07:43,450 INFO [M:0;jenkins-hbase9:35481] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 18:07:43,451 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 18:07:43,451 DEBUG [M:0;jenkins-hbase9:35481] zookeeper.ZKUtil(398): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 18:07:43,451 WARN [M:0;jenkins-hbase9:35481] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 18:07:43,451 INFO [M:0;jenkins-hbase9:35481] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:07:43,452 INFO [M:0;jenkins-hbase9:35481] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 18:07:43,452 DEBUG [M:0;jenkins-hbase9:35481] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 18:07:43,452 INFO [M:0;jenkins-hbase9:35481] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:07:43,452 DEBUG [M:0;jenkins-hbase9:35481] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:07:43,452 DEBUG [M:0;jenkins-hbase9:35481] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 18:07:43,452 DEBUG [M:0;jenkins-hbase9:35481] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:07:43,452 INFO [M:0;jenkins-hbase9:35481] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=334.10 KB heapSize=390.01 KB 2023-07-11 18:07:43,468 INFO [M:0;jenkins-hbase9:35481] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=334.10 KB at sequenceid=596 (bloomFilter=true), to=hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9d2ce5348cc1488ea5d7d2a51408c53d 2023-07-11 18:07:43,473 DEBUG [M:0;jenkins-hbase9:35481] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9d2ce5348cc1488ea5d7d2a51408c53d as hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9d2ce5348cc1488ea5d7d2a51408c53d 2023-07-11 18:07:43,477 INFO [M:0;jenkins-hbase9:35481] regionserver.HStore(1080): Added hdfs://localhost:36175/user/jenkins/test-data/6a46a9ac-6cf3-7428-cd40-155dd9dc86fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9d2ce5348cc1488ea5d7d2a51408c53d, entries=86, sequenceid=596, filesize=14.2 K 2023-07-11 18:07:43,478 INFO [M:0;jenkins-hbase9:35481] regionserver.HRegion(2948): Finished flush of dataSize ~334.10 KB/342116, heapSize ~389.99 KB/399352, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=596, compaction requested=false 2023-07-11 18:07:43,479 INFO [M:0;jenkins-hbase9:35481] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:07:43,479 DEBUG [M:0;jenkins-hbase9:35481] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 18:07:43,482 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 18:07:43,483 INFO [M:0;jenkins-hbase9:35481] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 18:07:43,483 INFO [M:0;jenkins-hbase9:35481] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35481 2023-07-11 18:07:43,486 DEBUG [M:0;jenkins-hbase9:35481] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,35481,1689098705729 already deleted, retry=false 2023-07-11 18:07:43,546 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:07:43,546 INFO [RS:1;jenkins-hbase9:33801] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,33801,1689098707010; zookeeper connection closed. 2023-07-11 18:07:43,546 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): regionserver:33801-0x10155819b8c0002, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:07:43,546 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1390535a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1390535a 2023-07-11 18:07:43,547 INFO [Listener at localhost/46025] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-11 18:07:43,646 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:07:43,646 INFO [M:0;jenkins-hbase9:35481] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,35481,1689098705729; zookeeper connection closed. 2023-07-11 18:07:43,646 DEBUG [Listener at localhost/46025-EventThread] zookeeper.ZKWatcher(600): master:35481-0x10155819b8c0000, quorum=127.0.0.1:56404, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:07:43,648 WARN [Listener at localhost/46025] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 18:07:43,651 INFO [Listener at localhost/46025] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 18:07:43,755 WARN [BP-1818992875-172.31.2.10-1689098702578 heartbeating to localhost/127.0.0.1:36175] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 18:07:43,755 WARN [BP-1818992875-172.31.2.10-1689098702578 heartbeating to localhost/127.0.0.1:36175] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1818992875-172.31.2.10-1689098702578 (Datanode Uuid c85e490d-5517-4ca1-b5e6-4ac751a4880c) service to localhost/127.0.0.1:36175 2023-07-11 18:07:43,758 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/cluster_23be2bdb-296d-eb19-651b-53674de03faf/dfs/data/data5/current/BP-1818992875-172.31.2.10-1689098702578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:07:43,758 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/cluster_23be2bdb-296d-eb19-651b-53674de03faf/dfs/data/data6/current/BP-1818992875-172.31.2.10-1689098702578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:07:43,759 WARN [Listener at localhost/46025] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 18:07:43,762 INFO [Listener at localhost/46025] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 18:07:43,763 WARN [BP-1818992875-172.31.2.10-1689098702578 heartbeating to localhost/127.0.0.1:36175] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 18:07:43,764 WARN [BP-1818992875-172.31.2.10-1689098702578 heartbeating to localhost/127.0.0.1:36175] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1818992875-172.31.2.10-1689098702578 (Datanode Uuid 9c0a647b-308a-487e-994a-e76bed2bc8f8) service to localhost/127.0.0.1:36175 2023-07-11 18:07:43,764 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/cluster_23be2bdb-296d-eb19-651b-53674de03faf/dfs/data/data3/current/BP-1818992875-172.31.2.10-1689098702578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:07:43,765 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/cluster_23be2bdb-296d-eb19-651b-53674de03faf/dfs/data/data4/current/BP-1818992875-172.31.2.10-1689098702578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:07:43,765 WARN [Listener at localhost/46025] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 18:07:43,773 INFO [Listener at localhost/46025] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 18:07:43,876 WARN [BP-1818992875-172.31.2.10-1689098702578 heartbeating to localhost/127.0.0.1:36175] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 18:07:43,876 WARN [BP-1818992875-172.31.2.10-1689098702578 heartbeating to localhost/127.0.0.1:36175] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1818992875-172.31.2.10-1689098702578 (Datanode Uuid edbd87bc-6a9e-43b8-a999-1f2b06c0eda4) service to localhost/127.0.0.1:36175 2023-07-11 18:07:43,877 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/cluster_23be2bdb-296d-eb19-651b-53674de03faf/dfs/data/data1/current/BP-1818992875-172.31.2.10-1689098702578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:07:43,877 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/09e6b8ae-47aa-4e93-9891-f83de86e7848/cluster_23be2bdb-296d-eb19-651b-53674de03faf/dfs/data/data2/current/BP-1818992875-172.31.2.10-1689098702578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:07:43,904 INFO [Listener at localhost/46025] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 18:07:44,032 INFO [Listener at localhost/46025] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 18:07:44,110 INFO [Listener at localhost/46025] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-11 18:07:44,124 INFO [Listener at localhost/46025] hbase.ResourceChecker(175): after: master.procedure.TestSCPWithMetaWithoutZKCoordinated#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=76 (was 9) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 java.lang.Thread.sleep(Native Method) org.apache.hadoop.metrics2.impl.JmxCacheBuster$JmxCacheBusterRunnable.run(JmxCacheBuster.java:101) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase9:0.Chore.1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReplicationExecutor-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase9:0.logRoller java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.wal.AbstractWALRoller.run(AbstractWALRoller.java:179) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase9:38785Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1091787570) connection to localhost/127.0.0.1:36175 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Abort regionserver monitor java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1091787570) connection to localhost/127.0.0.1:36175 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1091787570) connection to localhost/127.0.0.1:36175 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1091787570) connection to localhost/127.0.0.1:36175 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_META-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36175 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46025 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@226835c0 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:36175 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:36175 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=543 (was 256) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=76 (was 190), ProcessCount=180 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=9096 (was 9119)