2023-07-11 14:24:23,286 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta timeout: 13 mins 2023-07-11 14:24:23,329 INFO [Time-limited test] hbase.ResourceChecker(147): before: master.procedure.TestSCPWithMeta#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=9, OpenFileDescriptor=256, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=170, AvailableMemoryMB=8151 2023-07-11 14:24:23,570 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4 2023-07-11 14:24:23,574 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 14:24:23,574 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/cluster_74358967-39f9-bc17-2d36-57688478b8aa, deleteOnExit=true 2023-07-11 14:24:23,574 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 14:24:23,575 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/test.cache.data in system properties and HBase conf 2023-07-11 14:24:23,575 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 14:24:23,576 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/hadoop.log.dir in system properties and HBase conf 2023-07-11 14:24:23,576 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 14:24:23,577 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 14:24:23,577 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 14:24:23,675 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 14:24:24,036 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 14:24:24,040 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 14:24:24,040 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 14:24:24,041 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 14:24:24,041 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 14:24:24,041 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 14:24:24,042 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 14:24:24,042 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 14:24:24,042 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 14:24:24,042 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 14:24:24,043 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/nfs.dump.dir in system properties and HBase conf 2023-07-11 14:24:24,043 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/java.io.tmpdir in system properties and HBase conf 2023-07-11 14:24:24,043 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 14:24:24,043 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 14:24:24,044 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 14:24:24,516 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 14:24:24,520 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 14:24:24,799 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 14:24:24,952 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 14:24:24,966 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 14:24:25,002 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 14:24:25,033 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/java.io.tmpdir/Jetty_localhost_45091_hdfs____.3wvtpr/webapp 2023-07-11 14:24:25,190 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45091 2023-07-11 14:24:25,201 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 14:24:25,201 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 14:24:25,614 WARN [Listener at localhost/37125] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 14:24:25,687 WARN [Listener at localhost/37125] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 14:24:25,706 WARN [Listener at localhost/37125] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 14:24:25,712 INFO [Listener at localhost/37125] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 14:24:25,716 INFO [Listener at localhost/37125] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/java.io.tmpdir/Jetty_localhost_38627_datanode____m46tel/webapp 2023-07-11 14:24:25,814 INFO [Listener at localhost/37125] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38627 2023-07-11 14:24:26,116 WARN [Listener at localhost/40521] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 14:24:26,129 WARN [Listener at localhost/40521] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 14:24:26,133 WARN [Listener at localhost/40521] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 14:24:26,136 INFO [Listener at localhost/40521] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 14:24:26,143 INFO [Listener at localhost/40521] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/java.io.tmpdir/Jetty_localhost_43749_datanode____e6si9w/webapp 2023-07-11 14:24:26,240 INFO [Listener at localhost/40521] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43749 2023-07-11 14:24:26,251 WARN [Listener at localhost/33037] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 14:24:26,265 WARN [Listener at localhost/33037] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 14:24:26,269 WARN [Listener at localhost/33037] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 14:24:26,270 INFO [Listener at localhost/33037] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 14:24:26,276 INFO [Listener at localhost/33037] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/java.io.tmpdir/Jetty_localhost_46631_datanode____b3twzd/webapp 2023-07-11 14:24:26,382 INFO [Listener at localhost/33037] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46631 2023-07-11 14:24:26,389 WARN [Listener at localhost/44653] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 14:24:26,581 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc55ce28dc07ce065: Processing first storage report for DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3 from datanode 0fe677a8-c1f0-49cd-902f-ee596929a11b 2023-07-11 14:24:26,583 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc55ce28dc07ce065: from storage DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3 node DatanodeRegistration(127.0.0.1:40265, datanodeUuid=0fe677a8-c1f0-49cd-902f-ee596929a11b, infoPort=35757, infoSecurePort=0, ipcPort=33037, storageInfo=lv=-57;cid=testClusterID;nsid=711090313;c=1689085464591), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 14:24:26,583 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc353c5b1204ffdb8: Processing first storage report for DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf from datanode 3b380198-92da-4283-8c58-677877b807ad 2023-07-11 14:24:26,583 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc353c5b1204ffdb8: from storage DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf node DatanodeRegistration(127.0.0.1:34617, datanodeUuid=3b380198-92da-4283-8c58-677877b807ad, infoPort=45197, infoSecurePort=0, ipcPort=44653, storageInfo=lv=-57;cid=testClusterID;nsid=711090313;c=1689085464591), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 14:24:26,584 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe5cb3121c4da5904: Processing first storage report for DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39 from datanode a1f048c8-f8cd-48b3-b954-bbf81a4a8e67 2023-07-11 14:24:26,584 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe5cb3121c4da5904: from storage DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39 node DatanodeRegistration(127.0.0.1:41791, datanodeUuid=a1f048c8-f8cd-48b3-b954-bbf81a4a8e67, infoPort=36067, infoSecurePort=0, ipcPort=40521, storageInfo=lv=-57;cid=testClusterID;nsid=711090313;c=1689085464591), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 14:24:26,584 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc55ce28dc07ce065: Processing first storage report for DS-7d2cebb3-505b-498d-938a-62d002c7a4bf from datanode 0fe677a8-c1f0-49cd-902f-ee596929a11b 2023-07-11 14:24:26,584 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc55ce28dc07ce065: from storage DS-7d2cebb3-505b-498d-938a-62d002c7a4bf node DatanodeRegistration(127.0.0.1:40265, datanodeUuid=0fe677a8-c1f0-49cd-902f-ee596929a11b, infoPort=35757, infoSecurePort=0, ipcPort=33037, storageInfo=lv=-57;cid=testClusterID;nsid=711090313;c=1689085464591), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 14:24:26,584 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc353c5b1204ffdb8: Processing first storage report for DS-c341020c-309e-4fde-a5b0-5c1bbecfcc4b from datanode 3b380198-92da-4283-8c58-677877b807ad 2023-07-11 14:24:26,584 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc353c5b1204ffdb8: from storage DS-c341020c-309e-4fde-a5b0-5c1bbecfcc4b node DatanodeRegistration(127.0.0.1:34617, datanodeUuid=3b380198-92da-4283-8c58-677877b807ad, infoPort=45197, infoSecurePort=0, ipcPort=44653, storageInfo=lv=-57;cid=testClusterID;nsid=711090313;c=1689085464591), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 14:24:26,584 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe5cb3121c4da5904: Processing first storage report for DS-8c0ff336-252e-42ec-90e0-b5553ae18a12 from datanode a1f048c8-f8cd-48b3-b954-bbf81a4a8e67 2023-07-11 14:24:26,584 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe5cb3121c4da5904: from storage DS-8c0ff336-252e-42ec-90e0-b5553ae18a12 node DatanodeRegistration(127.0.0.1:41791, datanodeUuid=a1f048c8-f8cd-48b3-b954-bbf81a4a8e67, infoPort=36067, infoSecurePort=0, ipcPort=40521, storageInfo=lv=-57;cid=testClusterID;nsid=711090313;c=1689085464591), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 14:24:26,774 DEBUG [Listener at localhost/44653] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4 2023-07-11 14:24:26,838 INFO [Listener at localhost/44653] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/cluster_74358967-39f9-bc17-2d36-57688478b8aa/zookeeper_0, clientPort=54666, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/cluster_74358967-39f9-bc17-2d36-57688478b8aa/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/cluster_74358967-39f9-bc17-2d36-57688478b8aa/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 14:24:26,851 INFO [Listener at localhost/44653] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54666 2023-07-11 14:24:26,861 INFO [Listener at localhost/44653] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:24:26,863 INFO [Listener at localhost/44653] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:24:27,521 INFO [Listener at localhost/44653] util.FSUtils(471): Created version file at hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59 with version=8 2023-07-11 14:24:27,521 INFO [Listener at localhost/44653] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/hbase-staging 2023-07-11 14:24:27,814 INFO [Listener at localhost/44653] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 14:24:28,287 INFO [Listener at localhost/44653] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 14:24:28,319 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,319 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,319 INFO [Listener at localhost/44653] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 14:24:28,320 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,320 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 14:24:28,470 INFO [Listener at localhost/44653] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 14:24:28,540 DEBUG [Listener at localhost/44653] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 14:24:28,634 INFO [Listener at localhost/44653] ipc.NettyRpcServer(120): Bind to /172.31.2.10:33119 2023-07-11 14:24:28,644 INFO [Listener at localhost/44653] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:24:28,646 INFO [Listener at localhost/44653] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:24:28,665 INFO [Listener at localhost/44653] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33119 connecting to ZooKeeper ensemble=127.0.0.1:54666 2023-07-11 14:24:28,703 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:331190x0, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 14:24:28,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33119-0x10154b79c630000 connected 2023-07-11 14:24:28,729 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 14:24:28,730 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 14:24:28,733 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 14:24:28,740 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33119 2023-07-11 14:24:28,741 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33119 2023-07-11 14:24:28,742 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33119 2023-07-11 14:24:28,743 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33119 2023-07-11 14:24:28,744 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33119 2023-07-11 14:24:28,750 INFO [Listener at localhost/44653] master.HMaster(444): hbase.rootdir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59, hbase.cluster.distributed=false 2023-07-11 14:24:28,814 INFO [Listener at localhost/44653] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 14:24:28,815 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,815 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,815 INFO [Listener at localhost/44653] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 14:24:28,815 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,815 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 14:24:28,820 INFO [Listener at localhost/44653] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 14:24:28,822 INFO [Listener at localhost/44653] ipc.NettyRpcServer(120): Bind to /172.31.2.10:38737 2023-07-11 14:24:28,824 INFO [Listener at localhost/44653] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 14:24:28,830 DEBUG [Listener at localhost/44653] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 14:24:28,831 INFO [Listener at localhost/44653] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:24:28,833 INFO [Listener at localhost/44653] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:24:28,835 INFO [Listener at localhost/44653] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38737 connecting to ZooKeeper ensemble=127.0.0.1:54666 2023-07-11 14:24:28,839 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:387370x0, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 14:24:28,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38737-0x10154b79c630001 connected 2023-07-11 14:24:28,840 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 14:24:28,841 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 14:24:28,842 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 14:24:28,842 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38737 2023-07-11 14:24:28,843 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38737 2023-07-11 14:24:28,843 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38737 2023-07-11 14:24:28,843 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38737 2023-07-11 14:24:28,844 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38737 2023-07-11 14:24:28,856 INFO [Listener at localhost/44653] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 14:24:28,856 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,856 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,857 INFO [Listener at localhost/44653] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 14:24:28,857 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,857 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 14:24:28,858 INFO [Listener at localhost/44653] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 14:24:28,859 INFO [Listener at localhost/44653] ipc.NettyRpcServer(120): Bind to /172.31.2.10:42425 2023-07-11 14:24:28,860 INFO [Listener at localhost/44653] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 14:24:28,861 DEBUG [Listener at localhost/44653] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 14:24:28,862 INFO [Listener at localhost/44653] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:24:28,864 INFO [Listener at localhost/44653] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:24:28,866 INFO [Listener at localhost/44653] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42425 connecting to ZooKeeper ensemble=127.0.0.1:54666 2023-07-11 14:24:28,872 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:424250x0, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 14:24:28,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42425-0x10154b79c630002 connected 2023-07-11 14:24:28,873 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 14:24:28,874 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 14:24:28,875 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 14:24:28,875 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42425 2023-07-11 14:24:28,876 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42425 2023-07-11 14:24:28,876 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42425 2023-07-11 14:24:28,877 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42425 2023-07-11 14:24:28,877 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42425 2023-07-11 14:24:28,889 INFO [Listener at localhost/44653] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 14:24:28,889 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,889 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,889 INFO [Listener at localhost/44653] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 14:24:28,889 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 14:24:28,889 INFO [Listener at localhost/44653] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 14:24:28,890 INFO [Listener at localhost/44653] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 14:24:28,891 INFO [Listener at localhost/44653] ipc.NettyRpcServer(120): Bind to /172.31.2.10:36555 2023-07-11 14:24:28,891 INFO [Listener at localhost/44653] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 14:24:28,892 DEBUG [Listener at localhost/44653] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 14:24:28,893 INFO [Listener at localhost/44653] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:24:28,894 INFO [Listener at localhost/44653] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:24:28,895 INFO [Listener at localhost/44653] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36555 connecting to ZooKeeper ensemble=127.0.0.1:54666 2023-07-11 14:24:28,899 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:365550x0, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 14:24:28,900 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): regionserver:365550x0, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 14:24:28,901 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): regionserver:365550x0, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 14:24:28,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36555-0x10154b79c630003 connected 2023-07-11 14:24:28,902 DEBUG [Listener at localhost/44653] zookeeper.ZKUtil(164): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 14:24:28,902 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36555 2023-07-11 14:24:28,903 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36555 2023-07-11 14:24:28,903 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36555 2023-07-11 14:24:28,903 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36555 2023-07-11 14:24:28,904 DEBUG [Listener at localhost/44653] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36555 2023-07-11 14:24:28,905 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,33119,1689085467657 2023-07-11 14:24:28,914 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 14:24:28,915 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,33119,1689085467657 2023-07-11 14:24:28,933 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 14:24:28,933 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 14:24:28,933 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 14:24:28,933 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 14:24:28,933 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:24:28,934 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 14:24:28,936 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,33119,1689085467657 from backup master directory 2023-07-11 14:24:28,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 14:24:28,940 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,33119,1689085467657 2023-07-11 14:24:28,940 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 14:24:28,941 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 14:24:28,941 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,33119,1689085467657 2023-07-11 14:24:28,945 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 14:24:28,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 14:24:29,036 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/hbase.id with ID: 9a330a27-453d-4a94-83fb-7a1cafed9315 2023-07-11 14:24:29,077 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 14:24:29,091 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:24:29,155 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6c8b3845 to 127.0.0.1:54666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:24:29,189 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12320f0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:24:29,214 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 14:24:29,216 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 14:24:29,233 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 14:24:29,233 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 14:24:29,235 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:24:29,239 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:24:29,240 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 14:24:29,272 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/data/master/store-tmp 2023-07-11 14:24:29,308 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:29,308 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 14:24:29,309 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:24:29,309 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:24:29,309 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 14:24:29,309 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:24:29,309 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:24:29,309 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 14:24:29,311 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/WALs/jenkins-hbase9.apache.org,33119,1689085467657 2023-07-11 14:24:29,330 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33119%2C1689085467657, suffix=, logDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/WALs/jenkins-hbase9.apache.org,33119,1689085467657, archiveDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/oldWALs, maxLogs=10 2023-07-11 14:24:29,383 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK] 2023-07-11 14:24:29,383 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK] 2023-07-11 14:24:29,383 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK] 2023-07-11 14:24:29,391 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:24:29,456 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/WALs/jenkins-hbase9.apache.org,33119,1689085467657/jenkins-hbase9.apache.org%2C33119%2C1689085467657.1689085469340 2023-07-11 14:24:29,456 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK], DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK], DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK]] 2023-07-11 14:24:29,457 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:24:29,457 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:29,460 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:24:29,461 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:24:29,518 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:24:29,526 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 14:24:29,556 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 14:24:29,567 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:29,572 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:24:29,574 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:24:29,587 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 14:24:29,591 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:29,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61139865, jitterRate=-0.08894501626491547}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:24:29,592 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 14:24:29,593 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 14:24:29,611 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 14:24:29,611 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 14:24:29,614 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 14:24:29,615 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 14:24:29,646 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-07-11 14:24:29,646 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 14:24:29,670 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 14:24:29,675 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 14:24:29,698 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 14:24:29,701 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 14:24:29,702 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 14:24:29,706 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 14:24:29,710 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 14:24:29,713 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:24:29,714 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 14:24:29,715 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 14:24:29,726 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 14:24:29,731 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 14:24:29,731 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 14:24:29,731 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 14:24:29,731 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 14:24:29,731 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:24:29,731 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,33119,1689085467657, sessionid=0x10154b79c630000, setting cluster-up flag (Was=false) 2023-07-11 14:24:29,747 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:24:29,753 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 14:24:29,754 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,33119,1689085467657 2023-07-11 14:24:29,759 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:24:29,764 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 14:24:29,766 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,33119,1689085467657 2023-07-11 14:24:29,769 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.hbase-snapshot/.tmp 2023-07-11 14:24:29,807 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(951): ClusterId : 9a330a27-453d-4a94-83fb-7a1cafed9315 2023-07-11 14:24:29,807 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(951): ClusterId : 9a330a27-453d-4a94-83fb-7a1cafed9315 2023-07-11 14:24:29,807 INFO [RS:0;jenkins-hbase9:38737] regionserver.HRegionServer(951): ClusterId : 9a330a27-453d-4a94-83fb-7a1cafed9315 2023-07-11 14:24:29,812 DEBUG [RS:1;jenkins-hbase9:42425] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 14:24:29,812 DEBUG [RS:0;jenkins-hbase9:38737] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 14:24:29,812 DEBUG [RS:2;jenkins-hbase9:36555] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 14:24:29,818 DEBUG [RS:0;jenkins-hbase9:38737] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 14:24:29,818 DEBUG [RS:2;jenkins-hbase9:36555] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 14:24:29,818 DEBUG [RS:1;jenkins-hbase9:42425] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 14:24:29,818 DEBUG [RS:2;jenkins-hbase9:36555] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 14:24:29,818 DEBUG [RS:0;jenkins-hbase9:38737] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 14:24:29,818 DEBUG [RS:1;jenkins-hbase9:42425] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 14:24:29,822 DEBUG [RS:2;jenkins-hbase9:36555] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 14:24:29,822 DEBUG [RS:1;jenkins-hbase9:42425] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 14:24:29,823 DEBUG [RS:0;jenkins-hbase9:38737] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 14:24:29,825 DEBUG [RS:2;jenkins-hbase9:36555] zookeeper.ReadOnlyZKClient(139): Connect 0x7cd0f4da to 127.0.0.1:54666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:24:29,825 DEBUG [RS:1;jenkins-hbase9:42425] zookeeper.ReadOnlyZKClient(139): Connect 0x1bd96f42 to 127.0.0.1:54666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:24:29,825 DEBUG [RS:0;jenkins-hbase9:38737] zookeeper.ReadOnlyZKClient(139): Connect 0x16efbeef to 127.0.0.1:54666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:24:29,836 DEBUG [RS:2;jenkins-hbase9:36555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72171530, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:24:29,837 DEBUG [RS:2;jenkins-hbase9:36555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76289faa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 14:24:29,838 DEBUG [RS:1;jenkins-hbase9:42425] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@151e8249, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:24:29,838 DEBUG [RS:1;jenkins-hbase9:42425] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11210432, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 14:24:29,846 DEBUG [RS:0;jenkins-hbase9:38737] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18285242, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:24:29,846 DEBUG [RS:0;jenkins-hbase9:38737] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c17d59f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 14:24:29,866 DEBUG [RS:0;jenkins-hbase9:38737] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:38737 2023-07-11 14:24:29,867 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:42425 2023-07-11 14:24:29,870 INFO [RS:0;jenkins-hbase9:38737] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 14:24:29,870 INFO [RS:0;jenkins-hbase9:38737] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 14:24:29,870 INFO [RS:1;jenkins-hbase9:42425] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 14:24:29,870 INFO [RS:1;jenkins-hbase9:42425] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 14:24:29,870 DEBUG [RS:0;jenkins-hbase9:38737] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 14:24:29,871 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 14:24:29,871 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:36555 2023-07-11 14:24:29,872 INFO [RS:2;jenkins-hbase9:36555] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 14:24:29,872 INFO [RS:2;jenkins-hbase9:36555] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 14:24:29,872 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 14:24:29,873 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,33119,1689085467657 with isa=jenkins-hbase9.apache.org/172.31.2.10:42425, startcode=1689085468855 2023-07-11 14:24:29,873 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,33119,1689085467657 with isa=jenkins-hbase9.apache.org/172.31.2.10:36555, startcode=1689085468888 2023-07-11 14:24:29,873 INFO [RS:0;jenkins-hbase9:38737] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,33119,1689085467657 with isa=jenkins-hbase9.apache.org/172.31.2.10:38737, startcode=1689085468814 2023-07-11 14:24:29,891 DEBUG [RS:2;jenkins-hbase9:36555] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 14:24:29,891 DEBUG [RS:1;jenkins-hbase9:42425] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 14:24:29,891 DEBUG [RS:0;jenkins-hbase9:38737] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 14:24:29,903 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 14:24:29,913 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 14:24:29,913 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 14:24:29,914 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 14:24:29,914 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 14:24:29,914 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-11 14:24:29,914 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:29,915 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 14:24:29,915 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:29,917 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689085499917 2023-07-11 14:24:29,920 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 14:24:29,930 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 14:24:29,931 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 14:24:29,932 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 14:24:29,938 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 14:24:29,940 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 14:24:29,941 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 14:24:29,941 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 14:24:29,942 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 14:24:29,943 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:29,945 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 14:24:29,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 14:24:29,947 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 14:24:29,949 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52671, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 14:24:29,949 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38019, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 14:24:29,949 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33775, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 14:24:29,950 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 14:24:29,950 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 14:24:29,952 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689085469952,5,FailOnTimeoutGroup] 2023-07-11 14:24:29,953 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689085469952,5,FailOnTimeoutGroup] 2023-07-11 14:24:29,954 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:29,954 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 14:24:29,956 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:29,956 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:29,962 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33119] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:29,978 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33119] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:29,981 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33119] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:29,988 DEBUG [RS:0;jenkins-hbase9:38737] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59 2023-07-11 14:24:29,988 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59 2023-07-11 14:24:29,988 DEBUG [RS:0;jenkins-hbase9:38737] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37125 2023-07-11 14:24:29,988 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37125 2023-07-11 14:24:29,988 DEBUG [RS:0;jenkins-hbase9:38737] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 14:24:29,988 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59 2023-07-11 14:24:29,988 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 14:24:29,989 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37125 2023-07-11 14:24:29,989 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 14:24:29,990 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 14:24:29,991 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 14:24:29,991 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59 2023-07-11 14:24:30,000 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:24:30,001 DEBUG [RS:2;jenkins-hbase9:36555] zookeeper.ZKUtil(162): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:30,002 DEBUG [RS:1;jenkins-hbase9:42425] zookeeper.ZKUtil(162): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:30,002 WARN [RS:2;jenkins-hbase9:36555] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 14:24:30,002 WARN [RS:1;jenkins-hbase9:42425] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 14:24:30,003 INFO [RS:2;jenkins-hbase9:36555] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 14:24:30,003 INFO [RS:1;jenkins-hbase9:42425] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 14:24:30,003 DEBUG [RS:0;jenkins-hbase9:38737] zookeeper.ZKUtil(162): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:30,003 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:30,003 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:30,004 WARN [RS:0;jenkins-hbase9:38737] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 14:24:30,004 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,42425,1689085468855] 2023-07-11 14:24:30,004 INFO [RS:0;jenkins-hbase9:38737] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 14:24:30,004 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,38737,1689085468814] 2023-07-11 14:24:30,004 DEBUG [RS:0;jenkins-hbase9:38737] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:30,004 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,36555,1689085468888] 2023-07-11 14:24:30,017 DEBUG [RS:2;jenkins-hbase9:36555] zookeeper.ZKUtil(162): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:30,017 DEBUG [RS:1;jenkins-hbase9:42425] zookeeper.ZKUtil(162): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:30,017 DEBUG [RS:2;jenkins-hbase9:36555] zookeeper.ZKUtil(162): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:30,017 DEBUG [RS:1;jenkins-hbase9:42425] zookeeper.ZKUtil(162): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:30,022 DEBUG [RS:2;jenkins-hbase9:36555] zookeeper.ZKUtil(162): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:30,022 DEBUG [RS:1;jenkins-hbase9:42425] zookeeper.ZKUtil(162): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:30,025 DEBUG [RS:0;jenkins-hbase9:38737] zookeeper.ZKUtil(162): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:30,025 DEBUG [RS:0;jenkins-hbase9:38737] zookeeper.ZKUtil(162): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:30,026 DEBUG [RS:0;jenkins-hbase9:38737] zookeeper.ZKUtil(162): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:30,038 DEBUG [RS:0;jenkins-hbase9:38737] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 14:24:30,038 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 14:24:30,038 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 14:24:30,045 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:30,051 INFO [RS:0;jenkins-hbase9:38737] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 14:24:30,052 INFO [RS:2;jenkins-hbase9:36555] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 14:24:30,052 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 14:24:30,051 INFO [RS:1;jenkins-hbase9:42425] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 14:24:30,054 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/info 2023-07-11 14:24:30,055 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 14:24:30,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:30,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 14:24:30,058 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/rep_barrier 2023-07-11 14:24:30,059 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 14:24:30,059 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:30,060 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 14:24:30,062 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/table 2023-07-11 14:24:30,062 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 14:24:30,064 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:30,065 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740 2023-07-11 14:24:30,066 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740 2023-07-11 14:24:30,072 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:30,074 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 14:24:30,078 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:30,079 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70586228, jitterRate=0.05181676149368286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:30,079 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 14:24:30,079 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 14:24:30,079 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 14:24:30,079 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 14:24:30,079 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 14:24:30,079 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 14:24:30,082 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 14:24:30,082 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 14:24:30,083 INFO [RS:1;jenkins-hbase9:42425] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 14:24:30,083 INFO [RS:0;jenkins-hbase9:38737] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 14:24:30,083 INFO [RS:2;jenkins-hbase9:36555] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 14:24:30,088 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 14:24:30,088 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 14:24:30,091 INFO [RS:1;jenkins-hbase9:42425] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:24:30,091 INFO [RS:0;jenkins-hbase9:38737] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:24:30,092 INFO [RS:1;jenkins-hbase9:42425] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,091 INFO [RS:2;jenkins-hbase9:36555] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 14:24:30,092 INFO [RS:0;jenkins-hbase9:38737] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,093 INFO [RS:2;jenkins-hbase9:36555] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,094 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 14:24:30,094 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 14:24:30,094 INFO [RS:0;jenkins-hbase9:38737] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 14:24:30,098 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 14:24:30,103 INFO [RS:1;jenkins-hbase9:42425] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,103 INFO [RS:0;jenkins-hbase9:38737] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,103 DEBUG [RS:1;jenkins-hbase9:42425] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,103 INFO [RS:2;jenkins-hbase9:36555] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,103 DEBUG [RS:1;jenkins-hbase9:42425] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,103 DEBUG [RS:0;jenkins-hbase9:38737] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,104 DEBUG [RS:1;jenkins-hbase9:42425] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,104 DEBUG [RS:2;jenkins-hbase9:36555] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,104 DEBUG [RS:1;jenkins-hbase9:42425] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,104 DEBUG [RS:0;jenkins-hbase9:38737] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,104 DEBUG [RS:1;jenkins-hbase9:42425] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,104 DEBUG [RS:2;jenkins-hbase9:36555] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,104 DEBUG [RS:1;jenkins-hbase9:42425] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 14:24:30,104 DEBUG [RS:0;jenkins-hbase9:38737] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,104 DEBUG [RS:1;jenkins-hbase9:42425] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,104 DEBUG [RS:2;jenkins-hbase9:36555] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,104 DEBUG [RS:1;jenkins-hbase9:42425] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,105 DEBUG [RS:2;jenkins-hbase9:36555] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,105 DEBUG [RS:1;jenkins-hbase9:42425] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,105 DEBUG [RS:2;jenkins-hbase9:36555] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,105 DEBUG [RS:1;jenkins-hbase9:42425] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,104 DEBUG [RS:0;jenkins-hbase9:38737] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,105 DEBUG [RS:2;jenkins-hbase9:36555] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 14:24:30,105 DEBUG [RS:0;jenkins-hbase9:38737] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,105 DEBUG [RS:2;jenkins-hbase9:36555] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,105 DEBUG [RS:0;jenkins-hbase9:38737] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 14:24:30,105 DEBUG [RS:2;jenkins-hbase9:36555] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,105 DEBUG [RS:0;jenkins-hbase9:38737] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,105 DEBUG [RS:2;jenkins-hbase9:36555] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,106 DEBUG [RS:0;jenkins-hbase9:38737] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,106 DEBUG [RS:2;jenkins-hbase9:36555] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,106 DEBUG [RS:0;jenkins-hbase9:38737] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,106 DEBUG [RS:0;jenkins-hbase9:38737] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 14:24:30,112 INFO [RS:0;jenkins-hbase9:38737] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,112 INFO [RS:0;jenkins-hbase9:38737] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,112 INFO [RS:0;jenkins-hbase9:38737] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,113 INFO [RS:2;jenkins-hbase9:36555] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,113 INFO [RS:2;jenkins-hbase9:36555] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,113 INFO [RS:2;jenkins-hbase9:36555] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,113 INFO [RS:1;jenkins-hbase9:42425] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,113 INFO [RS:1;jenkins-hbase9:42425] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,114 INFO [RS:1;jenkins-hbase9:42425] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,118 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 14:24:30,120 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 14:24:30,132 INFO [RS:2;jenkins-hbase9:36555] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 14:24:30,132 INFO [RS:1;jenkins-hbase9:42425] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 14:24:30,132 INFO [RS:0;jenkins-hbase9:38737] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 14:24:30,135 INFO [RS:2;jenkins-hbase9:36555] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36555,1689085468888-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,135 INFO [RS:0;jenkins-hbase9:38737] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38737,1689085468814-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,135 INFO [RS:1;jenkins-hbase9:42425] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42425,1689085468855-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,159 INFO [RS:1;jenkins-hbase9:42425] regionserver.Replication(203): jenkins-hbase9.apache.org,42425,1689085468855 started 2023-07-11 14:24:30,159 INFO [RS:0;jenkins-hbase9:38737] regionserver.Replication(203): jenkins-hbase9.apache.org,38737,1689085468814 started 2023-07-11 14:24:30,159 INFO [RS:2;jenkins-hbase9:36555] regionserver.Replication(203): jenkins-hbase9.apache.org,36555,1689085468888 started 2023-07-11 14:24:30,159 INFO [RS:0;jenkins-hbase9:38737] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,38737,1689085468814, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:38737, sessionid=0x10154b79c630001 2023-07-11 14:24:30,159 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,42425,1689085468855, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:42425, sessionid=0x10154b79c630002 2023-07-11 14:24:30,159 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,36555,1689085468888, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:36555, sessionid=0x10154b79c630003 2023-07-11 14:24:30,159 DEBUG [RS:2;jenkins-hbase9:36555] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 14:24:30,159 DEBUG [RS:0;jenkins-hbase9:38737] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 14:24:30,159 DEBUG [RS:1;jenkins-hbase9:42425] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 14:24:30,160 DEBUG [RS:1;jenkins-hbase9:42425] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:30,160 DEBUG [RS:0;jenkins-hbase9:38737] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:30,160 DEBUG [RS:2;jenkins-hbase9:36555] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:30,160 DEBUG [RS:0;jenkins-hbase9:38737] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38737,1689085468814' 2023-07-11 14:24:30,160 DEBUG [RS:1;jenkins-hbase9:42425] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,42425,1689085468855' 2023-07-11 14:24:30,161 DEBUG [RS:1;jenkins-hbase9:42425] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:24:30,161 DEBUG [RS:0;jenkins-hbase9:38737] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:24:30,161 DEBUG [RS:2;jenkins-hbase9:36555] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,36555,1689085468888' 2023-07-11 14:24:30,161 DEBUG [RS:2;jenkins-hbase9:36555] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 14:24:30,161 DEBUG [RS:0;jenkins-hbase9:38737] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:24:30,162 DEBUG [RS:1;jenkins-hbase9:42425] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:24:30,161 DEBUG [RS:2;jenkins-hbase9:36555] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 14:24:30,162 DEBUG [RS:0;jenkins-hbase9:38737] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 14:24:30,162 DEBUG [RS:0;jenkins-hbase9:38737] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 14:24:30,162 DEBUG [RS:0;jenkins-hbase9:38737] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:30,162 DEBUG [RS:2;jenkins-hbase9:36555] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 14:24:30,162 DEBUG [RS:1;jenkins-hbase9:42425] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 14:24:30,162 DEBUG [RS:2;jenkins-hbase9:36555] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 14:24:30,162 DEBUG [RS:0;jenkins-hbase9:38737] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38737,1689085468814' 2023-07-11 14:24:30,163 DEBUG [RS:0;jenkins-hbase9:38737] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 14:24:30,162 DEBUG [RS:2;jenkins-hbase9:36555] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:30,162 DEBUG [RS:1;jenkins-hbase9:42425] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 14:24:30,163 DEBUG [RS:1;jenkins-hbase9:42425] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:30,163 DEBUG [RS:2;jenkins-hbase9:36555] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,36555,1689085468888' 2023-07-11 14:24:30,163 DEBUG [RS:2;jenkins-hbase9:36555] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 14:24:30,163 DEBUG [RS:1;jenkins-hbase9:42425] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,42425,1689085468855' 2023-07-11 14:24:30,163 DEBUG [RS:1;jenkins-hbase9:42425] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 14:24:30,163 DEBUG [RS:0;jenkins-hbase9:38737] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 14:24:30,164 DEBUG [RS:2;jenkins-hbase9:36555] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 14:24:30,164 DEBUG [RS:1;jenkins-hbase9:42425] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 14:24:30,164 DEBUG [RS:0;jenkins-hbase9:38737] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 14:24:30,164 INFO [RS:0;jenkins-hbase9:38737] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 14:24:30,164 INFO [RS:0;jenkins-hbase9:38737] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 14:24:30,164 DEBUG [RS:2;jenkins-hbase9:36555] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 14:24:30,164 DEBUG [RS:1;jenkins-hbase9:42425] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 14:24:30,164 INFO [RS:2;jenkins-hbase9:36555] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 14:24:30,165 INFO [RS:1;jenkins-hbase9:42425] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 14:24:30,165 INFO [RS:2;jenkins-hbase9:36555] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 14:24:30,165 INFO [RS:1;jenkins-hbase9:42425] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 14:24:30,272 DEBUG [jenkins-hbase9:33119] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-11 14:24:30,276 INFO [RS:0;jenkins-hbase9:38737] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38737%2C1689085468814, suffix=, logDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814, archiveDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/oldWALs, maxLogs=32 2023-07-11 14:24:30,277 INFO [RS:2;jenkins-hbase9:36555] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C36555%2C1689085468888, suffix=, logDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,36555,1689085468888, archiveDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/oldWALs, maxLogs=32 2023-07-11 14:24:30,277 INFO [RS:1;jenkins-hbase9:42425] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C42425%2C1689085468855, suffix=, logDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,42425,1689085468855, archiveDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/oldWALs, maxLogs=32 2023-07-11 14:24:30,278 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 14:24:30,283 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 14:24:30,284 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 14:24:30,284 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 14:24:30,284 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 14:24:30,287 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,38737,1689085468814, state=OPENING 2023-07-11 14:24:30,295 DEBUG [PEWorker-1] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 14:24:30,297 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:24:30,300 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 14:24:30,309 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK] 2023-07-11 14:24:30,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,38737,1689085468814}] 2023-07-11 14:24:30,311 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK] 2023-07-11 14:24:30,311 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK] 2023-07-11 14:24:30,311 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK] 2023-07-11 14:24:30,311 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK] 2023-07-11 14:24:30,312 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK] 2023-07-11 14:24:30,322 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK] 2023-07-11 14:24:30,322 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK] 2023-07-11 14:24:30,322 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK] 2023-07-11 14:24:30,331 INFO [RS:0;jenkins-hbase9:38737] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282 2023-07-11 14:24:30,332 INFO [RS:1;jenkins-hbase9:42425] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,42425,1689085468855/jenkins-hbase9.apache.org%2C42425%2C1689085468855.1689085470282 2023-07-11 14:24:30,332 INFO [RS:2;jenkins-hbase9:36555] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,36555,1689085468888/jenkins-hbase9.apache.org%2C36555%2C1689085468888.1689085470283 2023-07-11 14:24:30,333 DEBUG [RS:0;jenkins-hbase9:38737] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK], DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK], DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK]] 2023-07-11 14:24:30,338 DEBUG [RS:1;jenkins-hbase9:42425] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK], DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK], DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK]] 2023-07-11 14:24:30,341 DEBUG [RS:2;jenkins-hbase9:36555] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK], DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK], DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK]] 2023-07-11 14:24:30,504 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:30,507 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 14:24:30,510 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 14:24:30,522 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 14:24:30,523 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 14:24:30,526 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta, suffix=.meta, logDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814, archiveDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/oldWALs, maxLogs=32 2023-07-11 14:24:30,546 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK] 2023-07-11 14:24:30,547 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK] 2023-07-11 14:24:30,547 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK] 2023-07-11 14:24:30,553 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta 2023-07-11 14:24:30,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK], DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK], DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK]] 2023-07-11 14:24:30,554 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:24:30,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 14:24:30,575 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 14:24:30,580 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 14:24:30,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 14:24:30,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:30,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 14:24:30,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 14:24:30,588 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 14:24:30,590 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/info 2023-07-11 14:24:30,590 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/info 2023-07-11 14:24:30,591 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 14:24:30,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:30,592 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 14:24:30,593 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/rep_barrier 2023-07-11 14:24:30,593 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/rep_barrier 2023-07-11 14:24:30,594 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 14:24:30,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:30,595 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 14:24:30,596 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/table 2023-07-11 14:24:30,596 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/table 2023-07-11 14:24:30,596 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 14:24:30,597 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:30,599 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740 2023-07-11 14:24:30,602 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740 2023-07-11 14:24:30,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:30,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 14:24:30,609 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69634125, jitterRate=0.037629321217536926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:30,609 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 14:24:30,619 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689085470497 2023-07-11 14:24:30,636 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 14:24:30,636 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 14:24:30,637 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,38737,1689085468814, state=OPEN 2023-07-11 14:24:30,639 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 14:24:30,640 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 14:24:30,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 14:24:30,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,38737,1689085468814 in 330 msec 2023-07-11 14:24:30,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 14:24:30,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 548 msec 2023-07-11 14:24:30,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 832 msec 2023-07-11 14:24:30,654 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689085470654, completionTime=-1 2023-07-11 14:24:30,655 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-11 14:24:30,655 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 14:24:30,720 DEBUG [hconnection-0x5012bb09-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:24:30,723 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:24:30,739 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-11 14:24:30,739 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689085530739 2023-07-11 14:24:30,739 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689085590739 2023-07-11 14:24:30,739 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 84 msec 2023-07-11 14:24:30,762 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33119,1689085467657-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,762 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33119,1689085467657-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,762 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33119,1689085467657-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,764 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:33119, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,764 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 14:24:30,775 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 14:24:30,784 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 14:24:30,786 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 14:24:30,794 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 14:24:30,797 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:24:30,799 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:24:30,820 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/hbase/namespace/3300b91b6685c56113c82e496565fd11 2023-07-11 14:24:30,823 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/hbase/namespace/3300b91b6685c56113c82e496565fd11 empty. 2023-07-11 14:24:30,824 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/hbase/namespace/3300b91b6685c56113c82e496565fd11 2023-07-11 14:24:30,824 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 14:24:30,860 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 14:24:30,862 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3300b91b6685c56113c82e496565fd11, NAME => 'hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:30,884 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:30,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 3300b91b6685c56113c82e496565fd11, disabling compactions & flushes 2023-07-11 14:24:30,885 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:24:30,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:24:30,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. after waiting 0 ms 2023-07-11 14:24:30,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:24:30,885 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:24:30,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 3300b91b6685c56113c82e496565fd11: 2023-07-11 14:24:30,890 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:24:30,905 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689085470892"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085470892"}]},"ts":"1689085470892"} 2023-07-11 14:24:30,931 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 14:24:30,932 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:24:30,937 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689085470933"}]},"ts":"1689085470933"} 2023-07-11 14:24:30,941 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 14:24:30,945 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 14:24:30,947 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 14:24:30,947 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 14:24:30,947 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 14:24:30,947 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 14:24:30,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3300b91b6685c56113c82e496565fd11, ASSIGN}] 2023-07-11 14:24:30,952 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3300b91b6685c56113c82e496565fd11, ASSIGN 2023-07-11 14:24:30,954 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3300b91b6685c56113c82e496565fd11, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38737,1689085468814; forceNewPlan=false, retain=false 2023-07-11 14:24:31,106 INFO [jenkins-hbase9:33119] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 14:24:31,107 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3300b91b6685c56113c82e496565fd11, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:31,107 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689085471107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085471107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085471107"}]},"ts":"1689085471107"} 2023-07-11 14:24:31,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3300b91b6685c56113c82e496565fd11, server=jenkins-hbase9.apache.org,38737,1689085468814}] 2023-07-11 14:24:31,275 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:24:31,275 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3300b91b6685c56113c82e496565fd11, NAME => 'hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:24:31,277 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3300b91b6685c56113c82e496565fd11 2023-07-11 14:24:31,278 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,278 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3300b91b6685c56113c82e496565fd11 2023-07-11 14:24:31,278 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3300b91b6685c56113c82e496565fd11 2023-07-11 14:24:31,280 INFO [StoreOpener-3300b91b6685c56113c82e496565fd11-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3300b91b6685c56113c82e496565fd11 2023-07-11 14:24:31,282 DEBUG [StoreOpener-3300b91b6685c56113c82e496565fd11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/info 2023-07-11 14:24:31,282 DEBUG [StoreOpener-3300b91b6685c56113c82e496565fd11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/info 2023-07-11 14:24:31,283 INFO [StoreOpener-3300b91b6685c56113c82e496565fd11-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3300b91b6685c56113c82e496565fd11 columnFamilyName info 2023-07-11 14:24:31,284 INFO [StoreOpener-3300b91b6685c56113c82e496565fd11-1] regionserver.HStore(310): Store=3300b91b6685c56113c82e496565fd11/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:31,285 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11 2023-07-11 14:24:31,286 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11 2023-07-11 14:24:31,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3300b91b6685c56113c82e496565fd11 2023-07-11 14:24:31,294 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:31,295 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3300b91b6685c56113c82e496565fd11; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72719609, jitterRate=0.08360661566257477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:24:31,295 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3300b91b6685c56113c82e496565fd11: 2023-07-11 14:24:31,297 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11., pid=6, masterSystemTime=1689085471265 2023-07-11 14:24:31,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:24:31,301 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:24:31,303 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3300b91b6685c56113c82e496565fd11, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:31,303 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689085471302"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085471302"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085471302"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085471302"}]},"ts":"1689085471302"} 2023-07-11 14:24:31,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 14:24:31,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3300b91b6685c56113c82e496565fd11, server=jenkins-hbase9.apache.org,38737,1689085468814 in 197 msec 2023-07-11 14:24:31,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 14:24:31,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3300b91b6685c56113c82e496565fd11, ASSIGN in 362 msec 2023-07-11 14:24:31,317 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:24:31,317 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689085471317"}]},"ts":"1689085471317"} 2023-07-11 14:24:31,319 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 14:24:31,322 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:24:31,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 536 msec 2023-07-11 14:24:31,397 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 14:24:31,400 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 14:24:31,400 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:24:31,438 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 14:24:31,453 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 14:24:31,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-07-11 14:24:31,472 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 14:24:31,484 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 14:24:31,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-11 14:24:31,497 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 14:24:31,500 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 14:24:31,500 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.559sec 2023-07-11 14:24:31,503 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 14:24:31,505 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 14:24:31,505 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 14:24:31,506 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33119,1689085467657-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 14:24:31,507 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33119,1689085467657-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 14:24:31,514 DEBUG [Listener at localhost/44653] zookeeper.ReadOnlyZKClient(139): Connect 0x5daa0c55 to 127.0.0.1:54666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 14:24:31,516 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 14:24:31,518 DEBUG [Listener at localhost/44653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4716cdf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 14:24:31,531 DEBUG [hconnection-0x8db6223-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:24:31,542 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:24:31,552 INFO [Listener at localhost/44653] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,33119,1689085467657 2023-07-11 14:24:31,554 WARN [Listener at localhost/44653] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-11 14:24:31,564 DEBUG [Listener at localhost/44653] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 14:24:31,567 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:24:31,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 14:24:31,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 14:24:31,589 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 14:24:31,591 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 14:24:31,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true" procId is: 9 2023-07-11 14:24:31,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:24:31,621 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:24:31,621 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:24:31,621 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220 2023-07-11 14:24:31,621 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:24:31,621 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6 2023-07-11 14:24:31,621 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:24:31,621 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075 2023-07-11 14:24:31,621 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09 2023-07-11 14:24:31,622 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52 empty. 2023-07-11 14:24:31,622 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09 empty. 2023-07-11 14:24:31,622 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075 empty. 2023-07-11 14:24:31,622 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24 empty. 2023-07-11 14:24:31,622 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149 empty. 2023-07-11 14:24:31,623 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6 empty. 2023-07-11 14:24:31,623 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220 empty. 2023-07-11 14:24:31,625 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676 empty. 2023-07-11 14:24:31,625 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:24:31,625 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab empty. 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:24:31,627 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e 2023-07-11 14:24:31,627 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:24:31,627 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:24:31,626 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36 2023-07-11 14:24:31,627 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16 empty. 2023-07-11 14:24:31,627 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23 empty. 2023-07-11 14:24:31,627 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:24:31,628 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e empty. 2023-07-11 14:24:31,627 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:24:31,628 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36 empty. 2023-07-11 14:24:31,628 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1 empty. 2023-07-11 14:24:31,628 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:24:31,628 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:24:31,629 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e 2023-07-11 14:24:31,629 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:24:31,629 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4 empty. 2023-07-11 14:24:31,629 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0 empty. 2023-07-11 14:24:31,629 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:24:31,629 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36 2023-07-11 14:24:31,629 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:24:31,629 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095 2023-07-11 14:24:31,630 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047 empty. 2023-07-11 14:24:31,630 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:24:31,630 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:24:31,630 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:24:31,630 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:24:31,630 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892 empty. 2023-07-11 14:24:31,630 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd empty. 2023-07-11 14:24:31,630 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f empty. 2023-07-11 14:24:31,631 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:24:31,630 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:24:31,631 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:24:31,631 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47 2023-07-11 14:24:31,631 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095 empty. 2023-07-11 14:24:31,631 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad empty. 2023-07-11 14:24:31,631 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:24:31,631 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:24:31,631 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:24:31,632 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:24:31,632 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b empty. 2023-07-11 14:24:31,634 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:24:31,634 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095 2023-07-11 14:24:31,634 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210 empty. 2023-07-11 14:24:31,634 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:24:31,635 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943 empty. 2023-07-11 14:24:31,635 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:24:31,636 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47 empty. 2023-07-11 14:24:31,638 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:24:31,638 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47 2023-07-11 14:24:31,638 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true regions 2023-07-11 14:24:31,660 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/.tabledesc/.tableinfo.0000000001 2023-07-11 14:24:31,693 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 5a7a7878544668c682997c73147b1220, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220.', STARTKEY => 'ccc', ENDKEY => 'ddd'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,693 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => d300c1c4be5195cf92faac67764ebb52, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52.', STARTKEY => '', ENDKEY => 'bbb'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,693 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 66e7b46b2c70aaaa5ed558bcfa8ac676, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676.', STARTKEY => 'bbb', ENDKEY => 'ccc'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:24:31,732 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,733 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 5a7a7878544668c682997c73147b1220, disabling compactions & flushes 2023-07-11 14:24:31,738 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:24:31,738 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:24:31,738 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. after waiting 0 ms 2023-07-11 14:24:31,738 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:24:31,739 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:24:31,739 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 5a7a7878544668c682997c73147b1220: 2023-07-11 14:24:31,740 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 5931619e05cf0cf890fb2bcad4916149, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149.', STARTKEY => 'ddd', ENDKEY => 'eee'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,740 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,740 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing d300c1c4be5195cf92faac67764ebb52, disabling compactions & flushes 2023-07-11 14:24:31,741 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:24:31,741 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:24:31,741 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. after waiting 0 ms 2023-07-11 14:24:31,741 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:24:31,741 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:24:31,741 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for d300c1c4be5195cf92faac67764ebb52: 2023-07-11 14:24:31,742 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => ed162f49432e859aa69b9277091322c6, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6.', STARTKEY => 'eee', ENDKEY => 'fff'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,743 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,744 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 66e7b46b2c70aaaa5ed558bcfa8ac676, disabling compactions & flushes 2023-07-11 14:24:31,744 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:24:31,744 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:24:31,744 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. after waiting 0 ms 2023-07-11 14:24:31,744 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:24:31,744 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:24:31,744 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 66e7b46b2c70aaaa5ed558bcfa8ac676: 2023-07-11 14:24:31,745 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => ff6d38721d77dec2555b77bfec573075, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075.', STARTKEY => 'fff', ENDKEY => 'ggg'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,769 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,770 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 5931619e05cf0cf890fb2bcad4916149, disabling compactions & flushes 2023-07-11 14:24:31,770 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:24:31,770 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:24:31,770 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. after waiting 0 ms 2023-07-11 14:24:31,770 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:24:31,770 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:24:31,770 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,770 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 5931619e05cf0cf890fb2bcad4916149: 2023-07-11 14:24:31,770 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing ed162f49432e859aa69b9277091322c6, disabling compactions & flushes 2023-07-11 14:24:31,771 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:24:31,771 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:24:31,771 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 6a5aca3163b7bef744905773179c5d09, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09.', STARTKEY => 'ggg', ENDKEY => 'hhh'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,771 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. after waiting 0 ms 2023-07-11 14:24:31,771 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:24:31,771 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:24:31,771 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for ed162f49432e859aa69b9277091322c6: 2023-07-11 14:24:31,772 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => ac77e8e2fc5f54d54be1f5c59a7a3d24, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24.', STARTKEY => 'hhh', ENDKEY => 'iii'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,772 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,773 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing ff6d38721d77dec2555b77bfec573075, disabling compactions & flushes 2023-07-11 14:24:31,773 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:24:31,773 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:24:31,773 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. after waiting 0 ms 2023-07-11 14:24:31,773 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:24:31,773 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:24:31,773 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for ff6d38721d77dec2555b77bfec573075: 2023-07-11 14:24:31,774 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 82a6a2c5d8b4f8de1fbd3bdd41150dab, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab.', STARTKEY => 'iii', ENDKEY => 'jjj'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,806 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,807 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 82a6a2c5d8b4f8de1fbd3bdd41150dab, disabling compactions & flushes 2023-07-11 14:24:31,807 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:24:31,807 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:24:31,807 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,807 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. after waiting 0 ms 2023-07-11 14:24:31,809 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing ac77e8e2fc5f54d54be1f5c59a7a3d24, disabling compactions & flushes 2023-07-11 14:24:31,809 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:24:31,809 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:24:31,809 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,809 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:24:31,809 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 6a5aca3163b7bef744905773179c5d09, disabling compactions & flushes 2023-07-11 14:24:31,809 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:24:31,809 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:24:31,809 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. after waiting 0 ms 2023-07-11 14:24:31,809 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:24:31,809 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 82a6a2c5d8b4f8de1fbd3bdd41150dab: 2023-07-11 14:24:31,809 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. after waiting 0 ms 2023-07-11 14:24:31,809 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:24:31,810 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:24:31,810 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:24:31,810 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:24:31,810 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for ac77e8e2fc5f54d54be1f5c59a7a3d24: 2023-07-11 14:24:31,810 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 6a5aca3163b7bef744905773179c5d09: 2023-07-11 14:24:31,810 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => d6012602a1d2ab18cd68f81a87b29d16, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16.', STARTKEY => 'jjj', ENDKEY => 'kkk'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,810 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => dd06cff512fea186a79c12a85e039c36, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36.', STARTKEY => 'kkk', ENDKEY => 'lll'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,811 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 5b5d115c3d662e11393952c37d76b9b1, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1.', STARTKEY => 'lll', ENDKEY => 'mmm'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,837 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,837 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 5b5d115c3d662e11393952c37d76b9b1, disabling compactions & flushes 2023-07-11 14:24:31,837 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:24:31,837 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,837 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:24:31,838 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing d6012602a1d2ab18cd68f81a87b29d16, disabling compactions & flushes 2023-07-11 14:24:31,838 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:24:31,838 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:24:31,838 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. after waiting 0 ms 2023-07-11 14:24:31,838 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:24:31,838 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:24:31,838 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for d6012602a1d2ab18cd68f81a87b29d16: 2023-07-11 14:24:31,838 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. after waiting 0 ms 2023-07-11 14:24:31,839 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:24:31,839 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:24:31,839 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 5b5d115c3d662e11393952c37d76b9b1: 2023-07-11 14:24:31,839 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2d05c9e5bd88a0debf2d4f4cab371c23, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23.', STARTKEY => 'mmm', ENDKEY => 'nnn'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,840 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 88a55364cb44dcda432e2854a92e01b4, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4.', STARTKEY => 'nnn', ENDKEY => 'ooo'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,840 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,841 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing dd06cff512fea186a79c12a85e039c36, disabling compactions & flushes 2023-07-11 14:24:31,841 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:24:31,841 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:24:31,841 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. after waiting 0 ms 2023-07-11 14:24:31,841 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:24:31,841 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:24:31,841 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for dd06cff512fea186a79c12a85e039c36: 2023-07-11 14:24:31,842 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6ae32d4e7367668541894e8f3c21c047, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047.', STARTKEY => 'ooo', ENDKEY => 'ppp'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,868 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,869 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 2d05c9e5bd88a0debf2d4f4cab371c23, disabling compactions & flushes 2023-07-11 14:24:31,869 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:24:31,869 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:24:31,869 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. after waiting 0 ms 2023-07-11 14:24:31,869 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:24:31,869 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:24:31,869 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 2d05c9e5bd88a0debf2d4f4cab371c23: 2023-07-11 14:24:31,870 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 937337250fe5f867c4822d687fa0330e, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e.', STARTKEY => 'ppp', ENDKEY => 'qqq'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,872 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,872 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 6ae32d4e7367668541894e8f3c21c047, disabling compactions & flushes 2023-07-11 14:24:31,872 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:24:31,872 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:24:31,872 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. after waiting 0 ms 2023-07-11 14:24:31,872 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:24:31,873 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:24:31,873 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 6ae32d4e7367668541894e8f3c21c047: 2023-07-11 14:24:31,873 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 10dfb74a1a23ab15b405d903fdf243a0, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0.', STARTKEY => 'qqq', ENDKEY => 'rrr'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,873 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,874 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 88a55364cb44dcda432e2854a92e01b4, disabling compactions & flushes 2023-07-11 14:24:31,874 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:24:31,874 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:24:31,874 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. after waiting 0 ms 2023-07-11 14:24:31,874 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:24:31,874 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:24:31,874 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 88a55364cb44dcda432e2854a92e01b4: 2023-07-11 14:24:31,874 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 98b0bf96f74236d0e5d66c8a4188e4cd, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd.', STARTKEY => 'rrr', ENDKEY => 'sss'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,892 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,893 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 937337250fe5f867c4822d687fa0330e, disabling compactions & flushes 2023-07-11 14:24:31,893 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:24:31,893 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:24:31,893 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. after waiting 0 ms 2023-07-11 14:24:31,894 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:24:31,894 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:24:31,894 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 937337250fe5f867c4822d687fa0330e: 2023-07-11 14:24:31,894 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => fdb423248dfa9ba3bd628e031d476892, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892.', STARTKEY => 'sss', ENDKEY => 'ttt'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,897 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,898 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 10dfb74a1a23ab15b405d903fdf243a0, disabling compactions & flushes 2023-07-11 14:24:31,898 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:24:31,898 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:24:31,898 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. after waiting 0 ms 2023-07-11 14:24:31,898 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:24:31,899 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:24:31,899 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 10dfb74a1a23ab15b405d903fdf243a0: 2023-07-11 14:24:31,900 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => ab932ae57850da80400237dc1b0b1b2f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f.', STARTKEY => 'ttt', ENDKEY => 'uuu'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,906 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,907 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 98b0bf96f74236d0e5d66c8a4188e4cd, disabling compactions & flushes 2023-07-11 14:24:31,907 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:24:31,907 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:24:31,907 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. after waiting 0 ms 2023-07-11 14:24:31,907 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:24:31,907 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:24:31,907 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 98b0bf96f74236d0e5d66c8a4188e4cd: 2023-07-11 14:24:31,908 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => a731373ce9dfd79d55495dd18431f095, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095.', STARTKEY => 'uuu', ENDKEY => 'vvv'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:24:31,919 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,919 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing fdb423248dfa9ba3bd628e031d476892, disabling compactions & flushes 2023-07-11 14:24:31,919 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:24:31,919 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:24:31,919 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. after waiting 0 ms 2023-07-11 14:24:31,919 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:24:31,919 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:24:31,919 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for fdb423248dfa9ba3bd628e031d476892: 2023-07-11 14:24:31,920 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => 22b1c0abb82e1750694628a9ed9bc56b, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b.', STARTKEY => 'vvv', ENDKEY => 'www'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,921 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,921 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing ab932ae57850da80400237dc1b0b1b2f, disabling compactions & flushes 2023-07-11 14:24:31,921 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:24:31,921 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:24:31,922 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. after waiting 0 ms 2023-07-11 14:24:31,922 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:24:31,922 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:24:31,922 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for ab932ae57850da80400237dc1b0b1b2f: 2023-07-11 14:24:31,922 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6c668c42743ec462b9ac68b0ac69bdad, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad.', STARTKEY => 'www', ENDKEY => 'xxx'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,935 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,935 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing a731373ce9dfd79d55495dd18431f095, disabling compactions & flushes 2023-07-11 14:24:31,935 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:24:31,935 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:24:31,935 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. after waiting 0 ms 2023-07-11 14:24:31,935 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:24:31,935 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:24:31,935 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for a731373ce9dfd79d55495dd18431f095: 2023-07-11 14:24:31,936 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(7675): creating {ENCODED => 551dbd676cfcd99c09597e9fc5285210, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210.', STARTKEY => 'xxx', ENDKEY => 'yyy'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,945 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,947 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing 6c668c42743ec462b9ac68b0ac69bdad, disabling compactions & flushes 2023-07-11 14:24:31,947 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:24:31,947 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:24:31,947 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. after waiting 0 ms 2023-07-11 14:24:31,947 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:24:31,947 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:24:31,947 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for 6c668c42743ec462b9ac68b0ac69bdad: 2023-07-11 14:24:31,948 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec820b7b1bea419174597c47a0865f47, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47.', STARTKEY => 'yyy', ENDKEY => 'zzz'}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,950 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,950 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing 22b1c0abb82e1750694628a9ed9bc56b, disabling compactions & flushes 2023-07-11 14:24:31,950 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:24:31,950 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:24:31,950 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. after waiting 0 ms 2023-07-11 14:24:31,950 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:24:31,950 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:24:31,950 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for 22b1c0abb82e1750694628a9ed9bc56b: 2023-07-11 14:24:31,951 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(7675): creating {ENCODED => bb4185ff2e7cde2bd90fe9e4a90b7943, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943.', STARTKEY => 'zzz', ENDKEY => ''}, tableDescriptor='testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'colfamily11', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/.tmp 2023-07-11 14:24:31,974 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:31,974 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1604): Closing 551dbd676cfcd99c09597e9fc5285210, disabling compactions & flushes 2023-07-11 14:24:31,975 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:24:31,975 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:24:31,975 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. after waiting 0 ms 2023-07-11 14:24:31,975 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:24:31,975 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:24:31,975 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-2] regionserver.HRegion(1558): Region close journal for 551dbd676cfcd99c09597e9fc5285210: 2023-07-11 14:24:32,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:24:32,389 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,389 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,389 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1604): Closing ec820b7b1bea419174597c47a0865f47, disabling compactions & flushes 2023-07-11 14:24:32,389 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1604): Closing bb4185ff2e7cde2bd90fe9e4a90b7943, disabling compactions & flushes 2023-07-11 14:24:32,389 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:24:32,389 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:24:32,389 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:24:32,389 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:24:32,389 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. after waiting 0 ms 2023-07-11 14:24:32,390 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:24:32,390 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. after waiting 0 ms 2023-07-11 14:24:32,390 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:24:32,390 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:24:32,390 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-1] regionserver.HRegion(1558): Region close journal for bb4185ff2e7cde2bd90fe9e4a90b7943: 2023-07-11 14:24:32,390 INFO [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:24:32,390 DEBUG [RegionOpenAndInit-testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true-pool-0] regionserver.HRegion(1558): Region close journal for ec820b7b1bea419174597c47a0865f47: 2023-07-11 14:24:32,396 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 14:24:32,398 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,398 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,398 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,398 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,398 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,398 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,399 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,399 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,399 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,399 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,399 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,399 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,399 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,399 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,400 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,400 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,400 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,400 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,400 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,400 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,400 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,400 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,401 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,401 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,401 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,401 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689085472397"}]},"ts":"1689085472397"} 2023-07-11 14:24:32,450 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 26 regions to meta. 2023-07-11 14:24:32,452 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 14:24:32,453 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689085472452"}]},"ts":"1689085472452"} 2023-07-11 14:24:32,455 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLING in hbase:meta 2023-07-11 14:24:32,459 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 14:24:32,499 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 14:24:32,500 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 14:24:32,500 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 14:24:32,500 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 14:24:32,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d300c1c4be5195cf92faac67764ebb52, ASSIGN}, {pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66e7b46b2c70aaaa5ed558bcfa8ac676, ASSIGN}, {pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5a7a7878544668c682997c73147b1220, ASSIGN}, {pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5931619e05cf0cf890fb2bcad4916149, ASSIGN}, {pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ed162f49432e859aa69b9277091322c6, ASSIGN}, {pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ff6d38721d77dec2555b77bfec573075, ASSIGN}, {pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6a5aca3163b7bef744905773179c5d09, ASSIGN}, {pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ac77e8e2fc5f54d54be1f5c59a7a3d24, ASSIGN}, {pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=82a6a2c5d8b4f8de1fbd3bdd41150dab, ASSIGN}, {pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d6012602a1d2ab18cd68f81a87b29d16, ASSIGN}, {pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=dd06cff512fea186a79c12a85e039c36, ASSIGN}, {pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5b5d115c3d662e11393952c37d76b9b1, ASSIGN}, {pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2d05c9e5bd88a0debf2d4f4cab371c23, ASSIGN}, {pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=88a55364cb44dcda432e2854a92e01b4, ASSIGN}, {pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6ae32d4e7367668541894e8f3c21c047, ASSIGN}, {pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=937337250fe5f867c4822d687fa0330e, ASSIGN}, {pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=10dfb74a1a23ab15b405d903fdf243a0, ASSIGN}, {pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=98b0bf96f74236d0e5d66c8a4188e4cd, ASSIGN}, {pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdb423248dfa9ba3bd628e031d476892, ASSIGN}, {pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ab932ae57850da80400237dc1b0b1b2f, ASSIGN}, {pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a731373ce9dfd79d55495dd18431f095, ASSIGN}, {pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=22b1c0abb82e1750694628a9ed9bc56b, ASSIGN}, {pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6c668c42743ec462b9ac68b0ac69bdad, ASSIGN}, {pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=551dbd676cfcd99c09597e9fc5285210, ASSIGN}, {pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec820b7b1bea419174597c47a0865f47, ASSIGN}, {pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb4185ff2e7cde2bd90fe9e4a90b7943, ASSIGN}] 2023-07-11 14:24:32,511 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb4185ff2e7cde2bd90fe9e4a90b7943, ASSIGN 2023-07-11 14:24:32,513 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=35, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb4185ff2e7cde2bd90fe9e4a90b7943, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38737,1689085468814; forceNewPlan=false, retain=false 2023-07-11 14:24:32,514 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec820b7b1bea419174597c47a0865f47, ASSIGN 2023-07-11 14:24:32,515 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=34, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec820b7b1bea419174597c47a0865f47, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42425,1689085468855; forceNewPlan=false, retain=false 2023-07-11 14:24:32,517 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=551dbd676cfcd99c09597e9fc5285210, ASSIGN 2023-07-11 14:24:32,518 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=33, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=551dbd676cfcd99c09597e9fc5285210, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36555,1689085468888; forceNewPlan=false, retain=false 2023-07-11 14:24:32,519 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6c668c42743ec462b9ac68b0ac69bdad, ASSIGN 2023-07-11 14:24:32,521 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=32, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6c668c42743ec462b9ac68b0ac69bdad, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38737,1689085468814; forceNewPlan=false, retain=false 2023-07-11 14:24:32,522 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=22b1c0abb82e1750694628a9ed9bc56b, ASSIGN 2023-07-11 14:24:32,523 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=31, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=22b1c0abb82e1750694628a9ed9bc56b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42425,1689085468855; forceNewPlan=false, retain=false 2023-07-11 14:24:32,524 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a731373ce9dfd79d55495dd18431f095, ASSIGN 2023-07-11 14:24:32,525 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a731373ce9dfd79d55495dd18431f095, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36555,1689085468888; forceNewPlan=false, retain=false 2023-07-11 14:24:32,526 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ab932ae57850da80400237dc1b0b1b2f, ASSIGN 2023-07-11 14:24:32,526 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ab932ae57850da80400237dc1b0b1b2f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42425,1689085468855; forceNewPlan=false, retain=false 2023-07-11 14:24:32,527 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdb423248dfa9ba3bd628e031d476892, ASSIGN 2023-07-11 14:24:32,528 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdb423248dfa9ba3bd628e031d476892, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38737,1689085468814; forceNewPlan=false, retain=false 2023-07-11 14:24:32,530 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=98b0bf96f74236d0e5d66c8a4188e4cd, ASSIGN 2023-07-11 14:24:32,531 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=27, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=98b0bf96f74236d0e5d66c8a4188e4cd, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36555,1689085468888; forceNewPlan=false, retain=false 2023-07-11 14:24:32,532 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=10dfb74a1a23ab15b405d903fdf243a0, ASSIGN 2023-07-11 14:24:32,533 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=26, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=10dfb74a1a23ab15b405d903fdf243a0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42425,1689085468855; forceNewPlan=false, retain=false 2023-07-11 14:24:32,534 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=937337250fe5f867c4822d687fa0330e, ASSIGN 2023-07-11 14:24:32,535 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=25, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=937337250fe5f867c4822d687fa0330e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38737,1689085468814; forceNewPlan=false, retain=false 2023-07-11 14:24:32,536 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6ae32d4e7367668541894e8f3c21c047, ASSIGN 2023-07-11 14:24:32,537 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6ae32d4e7367668541894e8f3c21c047, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42425,1689085468855; forceNewPlan=false, retain=false 2023-07-11 14:24:32,538 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=88a55364cb44dcda432e2854a92e01b4, ASSIGN 2023-07-11 14:24:32,539 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=88a55364cb44dcda432e2854a92e01b4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36555,1689085468888; forceNewPlan=false, retain=false 2023-07-11 14:24:32,540 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2d05c9e5bd88a0debf2d4f4cab371c23, ASSIGN 2023-07-11 14:24:32,541 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=22, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2d05c9e5bd88a0debf2d4f4cab371c23, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38737,1689085468814; forceNewPlan=false, retain=false 2023-07-11 14:24:32,542 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5b5d115c3d662e11393952c37d76b9b1, ASSIGN 2023-07-11 14:24:32,543 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=21, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5b5d115c3d662e11393952c37d76b9b1, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42425,1689085468855; forceNewPlan=false, retain=false 2023-07-11 14:24:32,544 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=dd06cff512fea186a79c12a85e039c36, ASSIGN 2023-07-11 14:24:32,544 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=dd06cff512fea186a79c12a85e039c36, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36555,1689085468888; forceNewPlan=false, retain=false 2023-07-11 14:24:32,545 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d6012602a1d2ab18cd68f81a87b29d16, ASSIGN 2023-07-11 14:24:32,546 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d6012602a1d2ab18cd68f81a87b29d16, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38737,1689085468814; forceNewPlan=false, retain=false 2023-07-11 14:24:32,547 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=82a6a2c5d8b4f8de1fbd3bdd41150dab, ASSIGN 2023-07-11 14:24:32,548 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=82a6a2c5d8b4f8de1fbd3bdd41150dab, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38737,1689085468814; forceNewPlan=false, retain=false 2023-07-11 14:24:32,549 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ac77e8e2fc5f54d54be1f5c59a7a3d24, ASSIGN 2023-07-11 14:24:32,552 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ac77e8e2fc5f54d54be1f5c59a7a3d24, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42425,1689085468855; forceNewPlan=false, retain=false 2023-07-11 14:24:32,553 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6a5aca3163b7bef744905773179c5d09, ASSIGN 2023-07-11 14:24:32,554 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6a5aca3163b7bef744905773179c5d09, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36555,1689085468888; forceNewPlan=false, retain=false 2023-07-11 14:24:32,555 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ff6d38721d77dec2555b77bfec573075, ASSIGN 2023-07-11 14:24:32,556 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ff6d38721d77dec2555b77bfec573075, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36555,1689085468888; forceNewPlan=false, retain=false 2023-07-11 14:24:32,557 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ed162f49432e859aa69b9277091322c6, ASSIGN 2023-07-11 14:24:32,558 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ed162f49432e859aa69b9277091322c6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42425,1689085468855; forceNewPlan=false, retain=false 2023-07-11 14:24:32,559 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5931619e05cf0cf890fb2bcad4916149, ASSIGN 2023-07-11 14:24:32,560 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5931619e05cf0cf890fb2bcad4916149, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38737,1689085468814; forceNewPlan=false, retain=false 2023-07-11 14:24:32,560 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5a7a7878544668c682997c73147b1220, ASSIGN 2023-07-11 14:24:32,562 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5a7a7878544668c682997c73147b1220, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38737,1689085468814; forceNewPlan=false, retain=false 2023-07-11 14:24:32,562 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66e7b46b2c70aaaa5ed558bcfa8ac676, ASSIGN 2023-07-11 14:24:32,563 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66e7b46b2c70aaaa5ed558bcfa8ac676, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36555,1689085468888; forceNewPlan=false, retain=false 2023-07-11 14:24:32,564 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d300c1c4be5195cf92faac67764ebb52, ASSIGN 2023-07-11 14:24:32,565 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d300c1c4be5195cf92faac67764ebb52, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42425,1689085468855; forceNewPlan=false, retain=false 2023-07-11 14:24:32,663 INFO [jenkins-hbase9:33119] balancer.BaseLoadBalancer(1545): Reassigned 26 regions. 26 retained the pre-restart assignment. 2023-07-11 14:24:32,670 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=ac77e8e2fc5f54d54be1f5c59a7a3d24, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,671 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472670"}]},"ts":"1689085472670"} 2023-07-11 14:24:32,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=17, state=RUNNABLE; OpenRegionProcedure ac77e8e2fc5f54d54be1f5c59a7a3d24, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:24:32,679 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=6ae32d4e7367668541894e8f3c21c047, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,679 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472679"}]},"ts":"1689085472679"} 2023-07-11 14:24:32,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=24, state=RUNNABLE; OpenRegionProcedure 6ae32d4e7367668541894e8f3c21c047, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:24:32,685 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d300c1c4be5195cf92faac67764ebb52, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,686 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689085472685"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472685"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472685"}]},"ts":"1689085472685"} 2023-07-11 14:24:32,687 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=38, ppid=10, state=RUNNABLE; OpenRegionProcedure d300c1c4be5195cf92faac67764ebb52, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:24:32,691 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=ec820b7b1bea419174597c47a0865f47, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,692 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472691"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472691"}]},"ts":"1689085472691"} 2023-07-11 14:24:32,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=34, state=RUNNABLE; OpenRegionProcedure ec820b7b1bea419174597c47a0865f47, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:24:32,698 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=10dfb74a1a23ab15b405d903fdf243a0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,698 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472698"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472698"}]},"ts":"1689085472698"} 2023-07-11 14:24:32,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=26, state=RUNNABLE; OpenRegionProcedure 10dfb74a1a23ab15b405d903fdf243a0, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:24:32,704 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=5b5d115c3d662e11393952c37d76b9b1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,704 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472704"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472704"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472704"}]},"ts":"1689085472704"} 2023-07-11 14:24:32,706 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=21, state=RUNNABLE; OpenRegionProcedure 5b5d115c3d662e11393952c37d76b9b1, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:24:32,710 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ab932ae57850da80400237dc1b0b1b2f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,711 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472710"}]},"ts":"1689085472710"} 2023-07-11 14:24:32,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=42, ppid=29, state=RUNNABLE; OpenRegionProcedure ab932ae57850da80400237dc1b0b1b2f, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:24:32,717 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ed162f49432e859aa69b9277091322c6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:24:32,717 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472717"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472717"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472717"}]},"ts":"1689085472717"} 2023-07-11 14:24:32,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=14, state=RUNNABLE; OpenRegionProcedure ed162f49432e859aa69b9277091322c6, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:24:32,724 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=22b1c0abb82e1750694628a9ed9bc56b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,724 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472724"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472724"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472724"}]},"ts":"1689085472724"} 2023-07-11 14:24:32,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=31, state=RUNNABLE; OpenRegionProcedure 22b1c0abb82e1750694628a9ed9bc56b, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:24:32,731 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5a7a7878544668c682997c73147b1220, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:32,731 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472730"}]},"ts":"1689085472730"} 2023-07-11 14:24:32,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=12, state=RUNNABLE; OpenRegionProcedure 5a7a7878544668c682997c73147b1220, server=jenkins-hbase9.apache.org,38737,1689085468814}] 2023-07-11 14:24:32,736 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d6012602a1d2ab18cd68f81a87b29d16, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:32,736 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472736"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472736"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472736"}]},"ts":"1689085472736"} 2023-07-11 14:24:32,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=19, state=RUNNABLE; OpenRegionProcedure d6012602a1d2ab18cd68f81a87b29d16, server=jenkins-hbase9.apache.org,38737,1689085468814}] 2023-07-11 14:24:32,741 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=bb4185ff2e7cde2bd90fe9e4a90b7943, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:32,741 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689085472741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472741"}]},"ts":"1689085472741"} 2023-07-11 14:24:32,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; OpenRegionProcedure bb4185ff2e7cde2bd90fe9e4a90b7943, server=jenkins-hbase9.apache.org,38737,1689085468814}] 2023-07-11 14:24:32,747 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=82a6a2c5d8b4f8de1fbd3bdd41150dab, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:32,747 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472747"}]},"ts":"1689085472747"} 2023-07-11 14:24:32,749 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=18, state=RUNNABLE; OpenRegionProcedure 82a6a2c5d8b4f8de1fbd3bdd41150dab, server=jenkins-hbase9.apache.org,38737,1689085468814}] 2023-07-11 14:24:32,752 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=6c668c42743ec462b9ac68b0ac69bdad, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:32,752 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472752"}]},"ts":"1689085472752"} 2023-07-11 14:24:32,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=32, state=RUNNABLE; OpenRegionProcedure 6c668c42743ec462b9ac68b0ac69bdad, server=jenkins-hbase9.apache.org,38737,1689085468814}] 2023-07-11 14:24:32,757 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fdb423248dfa9ba3bd628e031d476892, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:32,758 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472757"}]},"ts":"1689085472757"} 2023-07-11 14:24:32,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=28, state=RUNNABLE; OpenRegionProcedure fdb423248dfa9ba3bd628e031d476892, server=jenkins-hbase9.apache.org,38737,1689085468814}] 2023-07-11 14:24:32,764 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=2d05c9e5bd88a0debf2d4f4cab371c23, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:32,764 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472764"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472764"}]},"ts":"1689085472764"} 2023-07-11 14:24:32,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=22, state=RUNNABLE; OpenRegionProcedure 2d05c9e5bd88a0debf2d4f4cab371c23, server=jenkins-hbase9.apache.org,38737,1689085468814}] 2023-07-11 14:24:32,769 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5931619e05cf0cf890fb2bcad4916149, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:32,769 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472769"}]},"ts":"1689085472769"} 2023-07-11 14:24:32,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=13, state=RUNNABLE; OpenRegionProcedure 5931619e05cf0cf890fb2bcad4916149, server=jenkins-hbase9.apache.org,38737,1689085468814}] 2023-07-11 14:24:32,775 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=937337250fe5f867c4822d687fa0330e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:32,775 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472775"}]},"ts":"1689085472775"} 2023-07-11 14:24:32,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=25, state=RUNNABLE; OpenRegionProcedure 937337250fe5f867c4822d687fa0330e, server=jenkins-hbase9.apache.org,38737,1689085468814}] 2023-07-11 14:24:32,781 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=dd06cff512fea186a79c12a85e039c36, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:32,781 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472781"}]},"ts":"1689085472781"} 2023-07-11 14:24:32,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=20, state=RUNNABLE; OpenRegionProcedure dd06cff512fea186a79c12a85e039c36, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:24:32,787 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=88a55364cb44dcda432e2854a92e01b4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:32,787 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472787"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472787"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472787"}]},"ts":"1689085472787"} 2023-07-11 14:24:32,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=23, state=RUNNABLE; OpenRegionProcedure 88a55364cb44dcda432e2854a92e01b4, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:24:32,792 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=98b0bf96f74236d0e5d66c8a4188e4cd, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:32,792 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472792"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472792"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472792"}]},"ts":"1689085472792"} 2023-07-11 14:24:32,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=27, state=RUNNABLE; OpenRegionProcedure 98b0bf96f74236d0e5d66c8a4188e4cd, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:24:32,797 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ff6d38721d77dec2555b77bfec573075, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:32,797 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472797"}]},"ts":"1689085472797"} 2023-07-11 14:24:32,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=15, state=RUNNABLE; OpenRegionProcedure ff6d38721d77dec2555b77bfec573075, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:24:32,802 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=a731373ce9dfd79d55495dd18431f095, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:32,802 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472802"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472802"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472802"}]},"ts":"1689085472802"} 2023-07-11 14:24:32,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=30, state=RUNNABLE; OpenRegionProcedure a731373ce9dfd79d55495dd18431f095, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:24:32,806 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=551dbd676cfcd99c09597e9fc5285210, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:32,806 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472806"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472806"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472806"}]},"ts":"1689085472806"} 2023-07-11 14:24:32,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=59, ppid=33, state=RUNNABLE; OpenRegionProcedure 551dbd676cfcd99c09597e9fc5285210, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:24:32,811 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6a5aca3163b7bef744905773179c5d09, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:32,811 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472811"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472811"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472811"}]},"ts":"1689085472811"} 2023-07-11 14:24:32,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=16, state=RUNNABLE; OpenRegionProcedure 6a5aca3163b7bef744905773179c5d09, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:24:32,816 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=66e7b46b2c70aaaa5ed558bcfa8ac676, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:32,816 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085472816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085472816"}]},"ts":"1689085472816"} 2023-07-11 14:24:32,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=11, state=RUNNABLE; OpenRegionProcedure 66e7b46b2c70aaaa5ed558bcfa8ac676, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:24:32,827 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,828 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 14:24:32,831 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 14:24:32,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:24:32,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 22b1c0abb82e1750694628a9ed9bc56b, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b.', STARTKEY => 'vvv', ENDKEY => 'www'} 2023-07-11 14:24:32,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:24:32,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:24:32,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:24:32,840 INFO [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:24:32,842 DEBUG [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/colfamily11 2023-07-11 14:24:32,842 DEBUG [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/colfamily11 2023-07-11 14:24:32,842 INFO [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22b1c0abb82e1750694628a9ed9bc56b columnFamilyName colfamily11 2023-07-11 14:24:32,843 INFO [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] regionserver.HStore(310): Store=22b1c0abb82e1750694628a9ed9bc56b/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,843 INFO [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:24:32,845 DEBUG [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/colfamily21 2023-07-11 14:24:32,845 DEBUG [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/colfamily21 2023-07-11 14:24:32,845 INFO [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22b1c0abb82e1750694628a9ed9bc56b columnFamilyName colfamily21 2023-07-11 14:24:32,846 INFO [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] regionserver.HStore(310): Store=22b1c0abb82e1750694628a9ed9bc56b/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,846 INFO [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:24:32,848 DEBUG [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/colfamily31 2023-07-11 14:24:32,848 DEBUG [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/colfamily31 2023-07-11 14:24:32,848 INFO [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22b1c0abb82e1750694628a9ed9bc56b columnFamilyName colfamily31 2023-07-11 14:24:32,849 INFO [StoreOpener-22b1c0abb82e1750694628a9ed9bc56b-1] regionserver.HStore(310): Store=22b1c0abb82e1750694628a9ed9bc56b/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:24:32,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:24:32,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:32,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:24:32,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:32,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 22b1c0abb82e1750694628a9ed9bc56b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69771573, jitterRate=0.0396774560213089}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:32,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 22b1c0abb82e1750694628a9ed9bc56b: 2023-07-11 14:24:32,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b., pid=44, masterSystemTime=1689085472827 2023-07-11 14:24:32,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:24:32,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:24:32,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:24:32,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ae32d4e7367668541894e8f3c21c047, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047.', STARTKEY => 'ooo', ENDKEY => 'ppp'} 2023-07-11 14:24:32,873 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=22b1c0abb82e1750694628a9ed9bc56b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:24:32,874 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472873"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085472873"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085472873"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085472873"}]},"ts":"1689085472873"} 2023-07-11 14:24:32,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:24:32,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:24:32,876 INFO [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:24:32,881 DEBUG [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/colfamily11 2023-07-11 14:24:32,881 DEBUG [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/colfamily11 2023-07-11 14:24:32,882 INFO [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ae32d4e7367668541894e8f3c21c047 columnFamilyName colfamily11 2023-07-11 14:24:32,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=31 2023-07-11 14:24:32,883 INFO [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] regionserver.HStore(310): Store=6ae32d4e7367668541894e8f3c21c047/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=31, state=SUCCESS; OpenRegionProcedure 22b1c0abb82e1750694628a9ed9bc56b, server=jenkins-hbase9.apache.org,42425,1689085468855 in 153 msec 2023-07-11 14:24:32,883 INFO [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:24:32,885 DEBUG [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/colfamily21 2023-07-11 14:24:32,886 DEBUG [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/colfamily21 2023-07-11 14:24:32,886 INFO [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ae32d4e7367668541894e8f3c21c047 columnFamilyName colfamily21 2023-07-11 14:24:32,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=22b1c0abb82e1750694628a9ed9bc56b, ASSIGN in 380 msec 2023-07-11 14:24:32,887 INFO [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] regionserver.HStore(310): Store=6ae32d4e7367668541894e8f3c21c047/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,887 INFO [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:24:32,889 DEBUG [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/colfamily31 2023-07-11 14:24:32,889 DEBUG [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/colfamily31 2023-07-11 14:24:32,890 INFO [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ae32d4e7367668541894e8f3c21c047 columnFamilyName colfamily31 2023-07-11 14:24:32,890 INFO [StoreOpener-6ae32d4e7367668541894e8f3c21c047-1] regionserver.HStore(310): Store=6ae32d4e7367668541894e8f3c21c047/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:24:32,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d05c9e5bd88a0debf2d4f4cab371c23, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2023-07-11 14:24:32,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:24:32,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:24:32,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:24:32,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:24:32,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:24:32,896 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:24:32,899 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily11 2023-07-11 14:24:32,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:32,899 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily11 2023-07-11 14:24:32,899 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d05c9e5bd88a0debf2d4f4cab371c23 columnFamilyName colfamily11 2023-07-11 14:24:32,900 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(310): Store=2d05c9e5bd88a0debf2d4f4cab371c23/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,900 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:24:32,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:24:32,903 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily21 2023-07-11 14:24:32,903 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily21 2023-07-11 14:24:32,905 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d05c9e5bd88a0debf2d4f4cab371c23 columnFamilyName colfamily21 2023-07-11 14:24:32,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:32,906 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(310): Store=2d05c9e5bd88a0debf2d4f4cab371c23/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,906 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:24:32,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 6ae32d4e7367668541894e8f3c21c047; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60815693, jitterRate=-0.09377555549144745}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:32,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 6ae32d4e7367668541894e8f3c21c047: 2023-07-11 14:24:32,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047., pid=37, masterSystemTime=1689085472827 2023-07-11 14:24:32,908 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily31 2023-07-11 14:24:32,908 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily31 2023-07-11 14:24:32,908 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d05c9e5bd88a0debf2d4f4cab371c23 columnFamilyName colfamily31 2023-07-11 14:24:32,909 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(310): Store=2d05c9e5bd88a0debf2d4f4cab371c23/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:24:32,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:24:32,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:24:32,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:24:32,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 10dfb74a1a23ab15b405d903fdf243a0, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2023-07-11 14:24:32,912 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=6ae32d4e7367668541894e8f3c21c047, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,912 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472912"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085472912"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085472912"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085472912"}]},"ts":"1689085472912"} 2023-07-11 14:24:32,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:24:32,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:24:32,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:24:32,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:24:32,914 INFO [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:24:32,918 DEBUG [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/colfamily11 2023-07-11 14:24:32,918 DEBUG [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/colfamily11 2023-07-11 14:24:32,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:32,919 INFO [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10dfb74a1a23ab15b405d903fdf243a0 columnFamilyName colfamily11 2023-07-11 14:24:32,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=24 2023-07-11 14:24:32,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=24, state=SUCCESS; OpenRegionProcedure 6ae32d4e7367668541894e8f3c21c047, server=jenkins-hbase9.apache.org,42425,1689085468855 in 234 msec 2023-07-11 14:24:32,919 INFO [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] regionserver.HStore(310): Store=10dfb74a1a23ab15b405d903fdf243a0/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,920 INFO [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:24:32,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:24:32,921 DEBUG [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/colfamily21 2023-07-11 14:24:32,921 DEBUG [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/colfamily21 2023-07-11 14:24:32,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6ae32d4e7367668541894e8f3c21c047, ASSIGN in 418 msec 2023-07-11 14:24:32,922 INFO [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10dfb74a1a23ab15b405d903fdf243a0 columnFamilyName colfamily21 2023-07-11 14:24:32,923 INFO [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] regionserver.HStore(310): Store=10dfb74a1a23ab15b405d903fdf243a0/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,923 INFO [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:24:32,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:32,925 DEBUG [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/colfamily31 2023-07-11 14:24:32,925 DEBUG [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/colfamily31 2023-07-11 14:24:32,925 INFO [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10dfb74a1a23ab15b405d903fdf243a0 columnFamilyName colfamily31 2023-07-11 14:24:32,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2d05c9e5bd88a0debf2d4f4cab371c23; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75161606, jitterRate=0.11999520659446716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:32,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2d05c9e5bd88a0debf2d4f4cab371c23: 2023-07-11 14:24:32,926 INFO [StoreOpener-10dfb74a1a23ab15b405d903fdf243a0-1] regionserver.HStore(310): Store=10dfb74a1a23ab15b405d903fdf243a0/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23., pid=51, masterSystemTime=1689085472884 2023-07-11 14:24:32,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:24:32,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:24:32,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:24:32,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:24:32,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:24:32,930 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=2d05c9e5bd88a0debf2d4f4cab371c23, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:32,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fdb423248dfa9ba3bd628e031d476892, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2023-07-11 14:24:32,930 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472930"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085472930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085472930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085472930"}]},"ts":"1689085472930"} 2023-07-11 14:24:32,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:24:32,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:24:32,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:24:32,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:32,934 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:24:32,937 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:32,937 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily11 2023-07-11 14:24:32,937 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 14:24:32,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:24:32,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=22 2023-07-11 14:24:32,937 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily11 2023-07-11 14:24:32,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=22, state=SUCCESS; OpenRegionProcedure 2d05c9e5bd88a0debf2d4f4cab371c23, server=jenkins-hbase9.apache.org,38737,1689085468814 in 167 msec 2023-07-11 14:24:32,940 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 14:24:32,940 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdb423248dfa9ba3bd628e031d476892 columnFamilyName colfamily11 2023-07-11 14:24:32,941 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(310): Store=fdb423248dfa9ba3bd628e031d476892/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,941 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:24:32,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:32,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2d05c9e5bd88a0debf2d4f4cab371c23, ASSIGN in 438 msec 2023-07-11 14:24:32,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 10dfb74a1a23ab15b405d903fdf243a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65289149, jitterRate=-0.027115866541862488}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:32,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 10dfb74a1a23ab15b405d903fdf243a0: 2023-07-11 14:24:32,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0., pid=40, masterSystemTime=1689085472827 2023-07-11 14:24:32,945 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily21 2023-07-11 14:24:32,945 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily21 2023-07-11 14:24:32,946 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdb423248dfa9ba3bd628e031d476892 columnFamilyName colfamily21 2023-07-11 14:24:32,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:24:32,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:24:32,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:24:32,946 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=10dfb74a1a23ab15b405d903fdf243a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ac77e8e2fc5f54d54be1f5c59a7a3d24, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24.', STARTKEY => 'hhh', ENDKEY => 'iii'} 2023-07-11 14:24:32,946 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472946"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085472946"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085472946"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085472946"}]},"ts":"1689085472946"} 2023-07-11 14:24:32,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:24:32,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:24:32,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:24:32,947 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(310): Store=fdb423248dfa9ba3bd628e031d476892/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,948 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:24:32,951 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily31 2023-07-11 14:24:32,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:24:32,952 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily31 2023-07-11 14:24:32,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 98b0bf96f74236d0e5d66c8a4188e4cd, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd.', STARTKEY => 'rrr', ENDKEY => 'sss'} 2023-07-11 14:24:32,952 INFO [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:24:32,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:24:32,952 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdb423248dfa9ba3bd628e031d476892 columnFamilyName colfamily31 2023-07-11 14:24:32,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:24:32,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:24:32,954 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(310): Store=fdb423248dfa9ba3bd628e031d476892/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=26 2023-07-11 14:24:32,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=26, state=SUCCESS; OpenRegionProcedure 10dfb74a1a23ab15b405d903fdf243a0, server=jenkins-hbase9.apache.org,42425,1689085468855 in 249 msec 2023-07-11 14:24:32,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:24:32,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:24:32,958 INFO [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:24:32,958 DEBUG [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/colfamily11 2023-07-11 14:24:32,958 DEBUG [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/colfamily11 2023-07-11 14:24:32,959 INFO [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac77e8e2fc5f54d54be1f5c59a7a3d24 columnFamilyName colfamily11 2023-07-11 14:24:32,960 INFO [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] regionserver.HStore(310): Store=ac77e8e2fc5f54d54be1f5c59a7a3d24/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,960 INFO [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:24:32,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=10dfb74a1a23ab15b405d903fdf243a0, ASSIGN in 453 msec 2023-07-11 14:24:32,960 DEBUG [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/colfamily11 2023-07-11 14:24:32,960 DEBUG [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/colfamily11 2023-07-11 14:24:32,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:32,961 INFO [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98b0bf96f74236d0e5d66c8a4188e4cd columnFamilyName colfamily11 2023-07-11 14:24:32,962 INFO [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] regionserver.HStore(310): Store=98b0bf96f74236d0e5d66c8a4188e4cd/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,962 INFO [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:24:32,962 DEBUG [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/colfamily21 2023-07-11 14:24:32,962 DEBUG [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/colfamily21 2023-07-11 14:24:32,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:24:32,963 INFO [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac77e8e2fc5f54d54be1f5c59a7a3d24 columnFamilyName colfamily21 2023-07-11 14:24:32,964 INFO [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] regionserver.HStore(310): Store=ac77e8e2fc5f54d54be1f5c59a7a3d24/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,964 INFO [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:24:32,964 DEBUG [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/colfamily21 2023-07-11 14:24:32,964 DEBUG [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/colfamily21 2023-07-11 14:24:32,965 INFO [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98b0bf96f74236d0e5d66c8a4188e4cd columnFamilyName colfamily21 2023-07-11 14:24:32,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:32,966 INFO [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] regionserver.HStore(310): Store=98b0bf96f74236d0e5d66c8a4188e4cd/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,966 INFO [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:24:32,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened fdb423248dfa9ba3bd628e031d476892; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70125659, jitterRate=0.04495374858379364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:32,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for fdb423248dfa9ba3bd628e031d476892: 2023-07-11 14:24:32,967 DEBUG [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/colfamily31 2023-07-11 14:24:32,967 DEBUG [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/colfamily31 2023-07-11 14:24:32,967 INFO [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac77e8e2fc5f54d54be1f5c59a7a3d24 columnFamilyName colfamily31 2023-07-11 14:24:32,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892., pid=50, masterSystemTime=1689085472884 2023-07-11 14:24:32,968 DEBUG [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/colfamily31 2023-07-11 14:24:32,968 DEBUG [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/colfamily31 2023-07-11 14:24:32,968 INFO [StoreOpener-ac77e8e2fc5f54d54be1f5c59a7a3d24-1] regionserver.HStore(310): Store=ac77e8e2fc5f54d54be1f5c59a7a3d24/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,969 INFO [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98b0bf96f74236d0e5d66c8a4188e4cd columnFamilyName colfamily31 2023-07-11 14:24:32,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:24:32,970 INFO [StoreOpener-98b0bf96f74236d0e5d66c8a4188e4cd-1] regionserver.HStore(310): Store=98b0bf96f74236d0e5d66c8a4188e4cd/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:24:32,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:24:32,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:24:32,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:24:32,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:24:32,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:24:32,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d6012602a1d2ab18cd68f81a87b29d16, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2023-07-11 14:24:32,973 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fdb423248dfa9ba3bd628e031d476892, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:32,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:24:32,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:24:32,973 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472973"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085472973"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085472973"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085472973"}]},"ts":"1689085472973"} 2023-07-11 14:24:32,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:24:32,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:32,976 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:24:32,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:24:32,978 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily11 2023-07-11 14:24:32,979 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily11 2023-07-11 14:24:32,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:32,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=28 2023-07-11 14:24:32,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=28, state=SUCCESS; OpenRegionProcedure fdb423248dfa9ba3bd628e031d476892, server=jenkins-hbase9.apache.org,38737,1689085468814 in 217 msec 2023-07-11 14:24:32,981 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6012602a1d2ab18cd68f81a87b29d16 columnFamilyName colfamily11 2023-07-11 14:24:32,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:24:32,982 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(310): Store=d6012602a1d2ab18cd68f81a87b29d16/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,983 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:24:32,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:32,983 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdb423248dfa9ba3bd628e031d476892, ASSIGN in 477 msec 2023-07-11 14:24:32,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ac77e8e2fc5f54d54be1f5c59a7a3d24; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58833229, jitterRate=-0.12331657111644745}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:32,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ac77e8e2fc5f54d54be1f5c59a7a3d24: 2023-07-11 14:24:32,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24., pid=36, masterSystemTime=1689085472827 2023-07-11 14:24:32,985 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily21 2023-07-11 14:24:32,985 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily21 2023-07-11 14:24:32,985 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6012602a1d2ab18cd68f81a87b29d16 columnFamilyName colfamily21 2023-07-11 14:24:32,987 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(310): Store=d6012602a1d2ab18cd68f81a87b29d16/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,987 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:24:32,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:32,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:24:32,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:24:32,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:24:32,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec820b7b1bea419174597c47a0865f47, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47.', STARTKEY => 'yyy', ENDKEY => 'zzz'} 2023-07-11 14:24:32,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 98b0bf96f74236d0e5d66c8a4188e4cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64412315, jitterRate=-0.040181711316108704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:32,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 98b0bf96f74236d0e5d66c8a4188e4cd: 2023-07-11 14:24:32,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ec820b7b1bea419174597c47a0865f47 2023-07-11 14:24:32,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ec820b7b1bea419174597c47a0865f47 2023-07-11 14:24:32,989 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily31 2023-07-11 14:24:32,989 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily31 2023-07-11 14:24:32,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ec820b7b1bea419174597c47a0865f47 2023-07-11 14:24:32,990 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=ac77e8e2fc5f54d54be1f5c59a7a3d24, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:32,990 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085472990"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085472990"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085472990"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085472990"}]},"ts":"1689085472990"} 2023-07-11 14:24:32,990 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6012602a1d2ab18cd68f81a87b29d16 columnFamilyName colfamily31 2023-07-11 14:24:32,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd., pid=56, masterSystemTime=1689085472936 2023-07-11 14:24:32,991 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(310): Store=d6012602a1d2ab18cd68f81a87b29d16/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:32,991 INFO [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ec820b7b1bea419174597c47a0865f47 2023-07-11 14:24:32,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:24:32,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:24:32,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:24:32,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:24:32,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:24:32,997 DEBUG [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/colfamily11 2023-07-11 14:24:32,998 DEBUG [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/colfamily11 2023-07-11 14:24:32,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88a55364cb44dcda432e2854a92e01b4, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2023-07-11 14:24:32,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=17 2023-07-11 14:24:32,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=17, state=SUCCESS; OpenRegionProcedure ac77e8e2fc5f54d54be1f5c59a7a3d24, server=jenkins-hbase9.apache.org,42425,1689085468855 in 321 msec 2023-07-11 14:24:32,998 INFO [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec820b7b1bea419174597c47a0865f47 columnFamilyName colfamily11 2023-07-11 14:24:32,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:24:32,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:32,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:24:32,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:24:32,999 INFO [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] regionserver.HStore(310): Store=ec820b7b1bea419174597c47a0865f47/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,000 INFO [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ec820b7b1bea419174597c47a0865f47 2023-07-11 14:24:33,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ac77e8e2fc5f54d54be1f5c59a7a3d24, ASSIGN in 497 msec 2023-07-11 14:24:33,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,001 INFO [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:24:33,002 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=98b0bf96f74236d0e5d66c8a4188e4cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:33,002 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473002"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473002"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473002"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473002"}]},"ts":"1689085473002"} 2023-07-11 14:24:33,003 DEBUG [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/colfamily21 2023-07-11 14:24:33,003 DEBUG [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/colfamily21 2023-07-11 14:24:33,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:24:33,003 INFO [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec820b7b1bea419174597c47a0865f47 columnFamilyName colfamily21 2023-07-11 14:24:33,004 DEBUG [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/colfamily11 2023-07-11 14:24:33,004 DEBUG [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/colfamily11 2023-07-11 14:24:33,005 INFO [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88a55364cb44dcda432e2854a92e01b4 columnFamilyName colfamily11 2023-07-11 14:24:33,005 INFO [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] regionserver.HStore(310): Store=ec820b7b1bea419174597c47a0865f47/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,005 INFO [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ec820b7b1bea419174597c47a0865f47 2023-07-11 14:24:33,006 INFO [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] regionserver.HStore(310): Store=88a55364cb44dcda432e2854a92e01b4/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,006 INFO [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:24:33,007 DEBUG [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/colfamily31 2023-07-11 14:24:33,007 DEBUG [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/colfamily31 2023-07-11 14:24:33,008 INFO [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec820b7b1bea419174597c47a0865f47 columnFamilyName colfamily31 2023-07-11 14:24:33,008 DEBUG [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/colfamily21 2023-07-11 14:24:33,009 DEBUG [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/colfamily21 2023-07-11 14:24:33,009 INFO [StoreOpener-ec820b7b1bea419174597c47a0865f47-1] regionserver.HStore(310): Store=ec820b7b1bea419174597c47a0865f47/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,009 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=27 2023-07-11 14:24:33,009 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=27, state=SUCCESS; OpenRegionProcedure 98b0bf96f74236d0e5d66c8a4188e4cd, server=jenkins-hbase9.apache.org,36555,1689085468888 in 211 msec 2023-07-11 14:24:33,009 INFO [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88a55364cb44dcda432e2854a92e01b4 columnFamilyName colfamily21 2023-07-11 14:24:33,010 INFO [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] regionserver.HStore(310): Store=88a55364cb44dcda432e2854a92e01b4/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,010 INFO [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:24:33,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=98b0bf96f74236d0e5d66c8a4188e4cd, ASSIGN in 508 msec 2023-07-11 14:24:33,012 DEBUG [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/colfamily31 2023-07-11 14:24:33,012 DEBUG [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/colfamily31 2023-07-11 14:24:33,012 INFO [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88a55364cb44dcda432e2854a92e01b4 columnFamilyName colfamily31 2023-07-11 14:24:33,013 INFO [StoreOpener-88a55364cb44dcda432e2854a92e01b4-1] regionserver.HStore(310): Store=88a55364cb44dcda432e2854a92e01b4/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47 2023-07-11 14:24:33,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:24:33,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47 2023-07-11 14:24:33,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:24:33,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d6012602a1d2ab18cd68f81a87b29d16; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60112941, jitterRate=-0.10424737632274628}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d6012602a1d2ab18cd68f81a87b29d16: 2023-07-11 14:24:33,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16., pid=46, masterSystemTime=1689085472884 2023-07-11 14:24:33,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ec820b7b1bea419174597c47a0865f47 2023-07-11 14:24:33,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:24:33,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:24:33,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:24:33,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:24:33,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82a6a2c5d8b4f8de1fbd3bdd41150dab, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2023-07-11 14:24:33,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:24:33,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:24:33,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:24:33,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,026 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d6012602a1d2ab18cd68f81a87b29d16, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:33,026 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473026"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473026"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473026"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473026"}]},"ts":"1689085473026"} 2023-07-11 14:24:33,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ec820b7b1bea419174597c47a0865f47; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74328132, jitterRate=0.10757547616958618}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ec820b7b1bea419174597c47a0865f47: 2023-07-11 14:24:33,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47., pid=39, masterSystemTime=1689085472827 2023-07-11 14:24:33,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:24:33,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:24:33,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:24:33,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d300c1c4be5195cf92faac67764ebb52, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52.', STARTKEY => '', ENDKEY => 'bbb'} 2023-07-11 14:24:33,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:24:33,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:24:33,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:24:33,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=19 2023-07-11 14:24:33,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=19, state=SUCCESS; OpenRegionProcedure d6012602a1d2ab18cd68f81a87b29d16, server=jenkins-hbase9.apache.org,38737,1689085468814 in 291 msec 2023-07-11 14:24:33,034 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:24:33,034 INFO [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:24:33,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d6012602a1d2ab18cd68f81a87b29d16, ASSIGN in 531 msec 2023-07-11 14:24:33,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 88a55364cb44dcda432e2854a92e01b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60347066, jitterRate=-0.1007586419582367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 88a55364cb44dcda432e2854a92e01b4: 2023-07-11 14:24:33,036 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=ec820b7b1bea419174597c47a0865f47, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:33,036 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473036"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473036"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473036"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473036"}]},"ts":"1689085473036"} 2023-07-11 14:24:33,036 DEBUG [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/colfamily11 2023-07-11 14:24:33,036 DEBUG [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/colfamily11 2023-07-11 14:24:33,036 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily11 2023-07-11 14:24:33,036 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily11 2023-07-11 14:24:33,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4., pid=55, masterSystemTime=1689085472936 2023-07-11 14:24:33,037 INFO [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d300c1c4be5195cf92faac67764ebb52 columnFamilyName colfamily11 2023-07-11 14:24:33,038 INFO [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] regionserver.HStore(310): Store=d300c1c4be5195cf92faac67764ebb52/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,038 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82a6a2c5d8b4f8de1fbd3bdd41150dab columnFamilyName colfamily11 2023-07-11 14:24:33,038 INFO [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:24:33,039 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(310): Store=82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:24:33,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:24:33,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:24:33,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a731373ce9dfd79d55495dd18431f095, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2023-07-11 14:24:33,040 DEBUG [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/colfamily21 2023-07-11 14:24:33,040 DEBUG [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/colfamily21 2023-07-11 14:24:33,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true a731373ce9dfd79d55495dd18431f095 2023-07-11 14:24:33,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a731373ce9dfd79d55495dd18431f095 2023-07-11 14:24:33,040 INFO [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d300c1c4be5195cf92faac67764ebb52 columnFamilyName colfamily21 2023-07-11 14:24:33,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a731373ce9dfd79d55495dd18431f095 2023-07-11 14:24:33,041 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:24:33,041 INFO [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] regionserver.HStore(310): Store=d300c1c4be5195cf92faac67764ebb52/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,041 INFO [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:24:33,042 INFO [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region a731373ce9dfd79d55495dd18431f095 2023-07-11 14:24:33,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=34 2023-07-11 14:24:33,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=34, state=SUCCESS; OpenRegionProcedure ec820b7b1bea419174597c47a0865f47, server=jenkins-hbase9.apache.org,42425,1689085468855 in 346 msec 2023-07-11 14:24:33,044 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily21 2023-07-11 14:24:33,044 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily21 2023-07-11 14:24:33,044 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82a6a2c5d8b4f8de1fbd3bdd41150dab columnFamilyName colfamily21 2023-07-11 14:24:33,045 DEBUG [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/colfamily11 2023-07-11 14:24:33,045 DEBUG [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/colfamily11 2023-07-11 14:24:33,045 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ec820b7b1bea419174597c47a0865f47, ASSIGN in 540 msec 2023-07-11 14:24:33,045 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(310): Store=82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,045 INFO [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a731373ce9dfd79d55495dd18431f095 columnFamilyName colfamily11 2023-07-11 14:24:33,045 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:24:33,046 INFO [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] regionserver.HStore(310): Store=a731373ce9dfd79d55495dd18431f095/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,046 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=88a55364cb44dcda432e2854a92e01b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:33,046 INFO [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region a731373ce9dfd79d55495dd18431f095 2023-07-11 14:24:33,047 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473046"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473046"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473046"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473046"}]},"ts":"1689085473046"} 2023-07-11 14:24:33,047 DEBUG [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/colfamily31 2023-07-11 14:24:33,047 DEBUG [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/colfamily31 2023-07-11 14:24:33,047 INFO [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d300c1c4be5195cf92faac67764ebb52 columnFamilyName colfamily31 2023-07-11 14:24:33,048 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily31 2023-07-11 14:24:33,048 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily31 2023-07-11 14:24:33,048 INFO [StoreOpener-d300c1c4be5195cf92faac67764ebb52-1] regionserver.HStore(310): Store=d300c1c4be5195cf92faac67764ebb52/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,049 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82a6a2c5d8b4f8de1fbd3bdd41150dab columnFamilyName colfamily31 2023-07-11 14:24:33,049 DEBUG [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/colfamily21 2023-07-11 14:24:33,049 DEBUG [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/colfamily21 2023-07-11 14:24:33,049 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(310): Store=82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:24:33,051 INFO [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a731373ce9dfd79d55495dd18431f095 columnFamilyName colfamily21 2023-07-11 14:24:33,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:24:33,052 INFO [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] regionserver.HStore(310): Store=a731373ce9dfd79d55495dd18431f095/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:24:33,052 INFO [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region a731373ce9dfd79d55495dd18431f095 2023-07-11 14:24:33,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:24:33,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=23 2023-07-11 14:24:33,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=23, state=SUCCESS; OpenRegionProcedure 88a55364cb44dcda432e2854a92e01b4, server=jenkins-hbase9.apache.org,36555,1689085468888 in 261 msec 2023-07-11 14:24:33,055 DEBUG [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/colfamily31 2023-07-11 14:24:33,055 DEBUG [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/colfamily31 2023-07-11 14:24:33,055 INFO [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a731373ce9dfd79d55495dd18431f095 columnFamilyName colfamily31 2023-07-11 14:24:33,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,057 INFO [StoreOpener-a731373ce9dfd79d55495dd18431f095-1] regionserver.HStore(310): Store=a731373ce9dfd79d55495dd18431f095/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=88a55364cb44dcda432e2854a92e01b4, ASSIGN in 553 msec 2023-07-11 14:24:33,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:24:33,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095 2023-07-11 14:24:33,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095 2023-07-11 14:24:33,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:24:33,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d300c1c4be5195cf92faac67764ebb52; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60000787, jitterRate=-0.10591860115528107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d300c1c4be5195cf92faac67764ebb52: 2023-07-11 14:24:33,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52., pid=38, masterSystemTime=1689085472827 2023-07-11 14:24:33,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:24:33,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:24:33,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:24:33,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed162f49432e859aa69b9277091322c6, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6.', STARTKEY => 'eee', ENDKEY => 'fff'} 2023-07-11 14:24:33,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 82a6a2c5d8b4f8de1fbd3bdd41150dab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59604898, jitterRate=-0.11181780695915222}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 82a6a2c5d8b4f8de1fbd3bdd41150dab: 2023-07-11 14:24:33,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ed162f49432e859aa69b9277091322c6 2023-07-11 14:24:33,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a731373ce9dfd79d55495dd18431f095 2023-07-11 14:24:33,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ed162f49432e859aa69b9277091322c6 2023-07-11 14:24:33,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab., pid=48, masterSystemTime=1689085472884 2023-07-11 14:24:33,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ed162f49432e859aa69b9277091322c6 2023-07-11 14:24:33,068 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d300c1c4be5195cf92faac67764ebb52, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:33,068 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689085473068"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473068"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473068"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473068"}]},"ts":"1689085473068"} 2023-07-11 14:24:33,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:24:33,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:24:33,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:24:33,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb4185ff2e7cde2bd90fe9e4a90b7943, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943.', STARTKEY => 'zzz', ENDKEY => ''} 2023-07-11 14:24:33,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:24:33,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a731373ce9dfd79d55495dd18431f095; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69361730, jitterRate=0.033570319414138794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a731373ce9dfd79d55495dd18431f095: 2023-07-11 14:24:33,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:24:33,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:24:33,072 INFO [StoreOpener-ed162f49432e859aa69b9277091322c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ed162f49432e859aa69b9277091322c6 2023-07-11 14:24:33,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095., pid=58, masterSystemTime=1689085472936 2023-07-11 14:24:33,074 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:24:33,075 DEBUG [StoreOpener-ed162f49432e859aa69b9277091322c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/colfamily11 2023-07-11 14:24:33,075 DEBUG [StoreOpener-ed162f49432e859aa69b9277091322c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/colfamily11 2023-07-11 14:24:33,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:24:33,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:24:33,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:24:33,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 551dbd676cfcd99c09597e9fc5285210, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2023-07-11 14:24:33,076 INFO [StoreOpener-ed162f49432e859aa69b9277091322c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed162f49432e859aa69b9277091322c6 columnFamilyName colfamily11 2023-07-11 14:24:33,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:24:33,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:24:33,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:24:33,077 INFO [StoreOpener-ed162f49432e859aa69b9277091322c6-1] regionserver.HStore(310): Store=ed162f49432e859aa69b9277091322c6/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=10 2023-07-11 14:24:33,077 INFO [StoreOpener-ed162f49432e859aa69b9277091322c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ed162f49432e859aa69b9277091322c6 2023-07-11 14:24:33,078 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily11 2023-07-11 14:24:33,078 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily11 2023-07-11 14:24:33,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=10, state=SUCCESS; OpenRegionProcedure d300c1c4be5195cf92faac67764ebb52, server=jenkins-hbase9.apache.org,42425,1689085468855 in 384 msec 2023-07-11 14:24:33,078 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4185ff2e7cde2bd90fe9e4a90b7943 columnFamilyName colfamily11 2023-07-11 14:24:33,079 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(310): Store=bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,079 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:24:33,080 DEBUG [StoreOpener-ed162f49432e859aa69b9277091322c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/colfamily21 2023-07-11 14:24:33,080 DEBUG [StoreOpener-ed162f49432e859aa69b9277091322c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/colfamily21 2023-07-11 14:24:33,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d300c1c4be5195cf92faac67764ebb52, ASSIGN in 577 msec 2023-07-11 14:24:33,081 INFO [StoreOpener-ed162f49432e859aa69b9277091322c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed162f49432e859aa69b9277091322c6 columnFamilyName colfamily21 2023-07-11 14:24:33,081 INFO [StoreOpener-ed162f49432e859aa69b9277091322c6-1] regionserver.HStore(310): Store=ed162f49432e859aa69b9277091322c6/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,081 INFO [StoreOpener-ed162f49432e859aa69b9277091322c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ed162f49432e859aa69b9277091322c6 2023-07-11 14:24:33,082 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily21 2023-07-11 14:24:33,082 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=a731373ce9dfd79d55495dd18431f095, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:33,082 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily21 2023-07-11 14:24:33,082 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473082"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473082"}]},"ts":"1689085473082"} 2023-07-11 14:24:33,082 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4185ff2e7cde2bd90fe9e4a90b7943 columnFamilyName colfamily21 2023-07-11 14:24:33,083 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(310): Store=bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,083 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:24:33,084 DEBUG [StoreOpener-ed162f49432e859aa69b9277091322c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/colfamily31 2023-07-11 14:24:33,084 DEBUG [StoreOpener-ed162f49432e859aa69b9277091322c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/colfamily31 2023-07-11 14:24:33,085 INFO [StoreOpener-ed162f49432e859aa69b9277091322c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed162f49432e859aa69b9277091322c6 columnFamilyName colfamily31 2023-07-11 14:24:33,086 INFO [StoreOpener-ed162f49432e859aa69b9277091322c6-1] regionserver.HStore(310): Store=ed162f49432e859aa69b9277091322c6/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,086 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily31 2023-07-11 14:24:33,086 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily31 2023-07-11 14:24:33,086 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4185ff2e7cde2bd90fe9e4a90b7943 columnFamilyName colfamily31 2023-07-11 14:24:33,087 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(310): Store=bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=30 2023-07-11 14:24:33,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=30, state=SUCCESS; OpenRegionProcedure a731373ce9dfd79d55495dd18431f095, server=jenkins-hbase9.apache.org,36555,1689085468888 in 282 msec 2023-07-11 14:24:33,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=a731373ce9dfd79d55495dd18431f095, ASSIGN in 585 msec 2023-07-11 14:24:33,090 INFO [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:24:33,090 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=82a6a2c5d8b4f8de1fbd3bdd41150dab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:33,090 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473090"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473090"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473090"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473090"}]},"ts":"1689085473090"} 2023-07-11 14:24:33,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:24:33,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:24:33,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6 2023-07-11 14:24:33,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6 2023-07-11 14:24:33,095 DEBUG [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/colfamily11 2023-07-11 14:24:33,095 DEBUG [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/colfamily11 2023-07-11 14:24:33,095 INFO [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 551dbd676cfcd99c09597e9fc5285210 columnFamilyName colfamily11 2023-07-11 14:24:33,096 INFO [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] regionserver.HStore(310): Store=551dbd676cfcd99c09597e9fc5285210/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,096 INFO [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:24:33,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=18 2023-07-11 14:24:33,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=18, state=SUCCESS; OpenRegionProcedure 82a6a2c5d8b4f8de1fbd3bdd41150dab, server=jenkins-hbase9.apache.org,38737,1689085468814 in 347 msec 2023-07-11 14:24:33,100 DEBUG [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/colfamily21 2023-07-11 14:24:33,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:24:33,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ed162f49432e859aa69b9277091322c6 2023-07-11 14:24:33,101 DEBUG [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/colfamily21 2023-07-11 14:24:33,101 INFO [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 551dbd676cfcd99c09597e9fc5285210 columnFamilyName colfamily21 2023-07-11 14:24:33,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=82a6a2c5d8b4f8de1fbd3bdd41150dab, ASSIGN in 599 msec 2023-07-11 14:24:33,103 INFO [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] regionserver.HStore(310): Store=551dbd676cfcd99c09597e9fc5285210/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,103 INFO [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:24:33,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ed162f49432e859aa69b9277091322c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66677485, jitterRate=-0.006428048014640808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ed162f49432e859aa69b9277091322c6: 2023-07-11 14:24:33,105 DEBUG [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/colfamily31 2023-07-11 14:24:33,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened bb4185ff2e7cde2bd90fe9e4a90b7943; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74316279, jitterRate=0.1073988527059555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for bb4185ff2e7cde2bd90fe9e4a90b7943: 2023-07-11 14:24:33,106 DEBUG [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/colfamily31 2023-07-11 14:24:33,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6., pid=43, masterSystemTime=1689085472827 2023-07-11 14:24:33,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943., pid=47, masterSystemTime=1689085472884 2023-07-11 14:24:33,107 INFO [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 551dbd676cfcd99c09597e9fc5285210 columnFamilyName colfamily31 2023-07-11 14:24:33,108 INFO [StoreOpener-551dbd676cfcd99c09597e9fc5285210-1] regionserver.HStore(310): Store=551dbd676cfcd99c09597e9fc5285210/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:24:33,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:24:33,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:24:33,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:24:33,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:24:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ab932ae57850da80400237dc1b0b1b2f, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2023-07-11 14:24:33,111 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ed162f49432e859aa69b9277091322c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:24:33,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:24:33,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:24:33,111 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473111"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473111"}]},"ts":"1689085473111"} 2023-07-11 14:24:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 937337250fe5f867c4822d687fa0330e, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2023-07-11 14:24:33,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 937337250fe5f867c4822d687fa0330e 2023-07-11 14:24:33,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 937337250fe5f867c4822d687fa0330e 2023-07-11 14:24:33,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 937337250fe5f867c4822d687fa0330e 2023-07-11 14:24:33,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:24:33,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:24:33,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:24:33,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:24:33,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=14 2023-07-11 14:24:33,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=14, state=SUCCESS; OpenRegionProcedure ed162f49432e859aa69b9277091322c6, server=jenkins-hbase9.apache.org,42425,1689085468855 in 395 msec 2023-07-11 14:24:33,118 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 937337250fe5f867c4822d687fa0330e 2023-07-11 14:24:33,118 INFO [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:24:33,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ed162f49432e859aa69b9277091322c6, ASSIGN in 616 msec 2023-07-11 14:24:33,119 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily11 2023-07-11 14:24:33,120 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily11 2023-07-11 14:24:33,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,121 DEBUG [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/colfamily11 2023-07-11 14:24:33,121 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 937337250fe5f867c4822d687fa0330e columnFamilyName colfamily11 2023-07-11 14:24:33,121 DEBUG [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/colfamily11 2023-07-11 14:24:33,122 INFO [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab932ae57850da80400237dc1b0b1b2f columnFamilyName colfamily11 2023-07-11 14:24:33,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 551dbd676cfcd99c09597e9fc5285210; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68602261, jitterRate=0.02225334942340851}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 551dbd676cfcd99c09597e9fc5285210: 2023-07-11 14:24:33,122 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(310): Store=937337250fe5f867c4822d687fa0330e/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,122 INFO [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] regionserver.HStore(310): Store=ab932ae57850da80400237dc1b0b1b2f/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,123 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 937337250fe5f867c4822d687fa0330e 2023-07-11 14:24:33,123 INFO [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:24:33,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210., pid=59, masterSystemTime=1689085472936 2023-07-11 14:24:33,125 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily21 2023-07-11 14:24:33,125 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily21 2023-07-11 14:24:33,125 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 937337250fe5f867c4822d687fa0330e columnFamilyName colfamily21 2023-07-11 14:24:33,125 DEBUG [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/colfamily21 2023-07-11 14:24:33,125 DEBUG [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/colfamily21 2023-07-11 14:24:33,126 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=bb4185ff2e7cde2bd90fe9e4a90b7943, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:33,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:24:33,126 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(310): Store=937337250fe5f867c4822d687fa0330e/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:24:33,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:24:33,126 INFO [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab932ae57850da80400237dc1b0b1b2f columnFamilyName colfamily21 2023-07-11 14:24:33,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6a5aca3163b7bef744905773179c5d09, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09.', STARTKEY => 'ggg', ENDKEY => 'hhh'} 2023-07-11 14:24:33,126 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 937337250fe5f867c4822d687fa0330e 2023-07-11 14:24:33,126 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689085473125"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473125"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473125"}]},"ts":"1689085473125"} 2023-07-11 14:24:33,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 6a5aca3163b7bef744905773179c5d09 2023-07-11 14:24:33,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 6a5aca3163b7bef744905773179c5d09 2023-07-11 14:24:33,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 6a5aca3163b7bef744905773179c5d09 2023-07-11 14:24:33,127 INFO [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] regionserver.HStore(310): Store=ab932ae57850da80400237dc1b0b1b2f/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,127 INFO [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:24:33,128 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily31 2023-07-11 14:24:33,128 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily31 2023-07-11 14:24:33,129 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 937337250fe5f867c4822d687fa0330e columnFamilyName colfamily31 2023-07-11 14:24:33,130 DEBUG [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/colfamily31 2023-07-11 14:24:33,130 DEBUG [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/colfamily31 2023-07-11 14:24:33,130 INFO [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab932ae57850da80400237dc1b0b1b2f columnFamilyName colfamily31 2023-07-11 14:24:33,130 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(310): Store=937337250fe5f867c4822d687fa0330e/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,131 INFO [StoreOpener-ab932ae57850da80400237dc1b0b1b2f-1] regionserver.HStore(310): Store=ab932ae57850da80400237dc1b0b1b2f/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-07-11 14:24:33,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; OpenRegionProcedure bb4185ff2e7cde2bd90fe9e4a90b7943, server=jenkins-hbase9.apache.org,38737,1689085468814 in 386 msec 2023-07-11 14:24:33,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb4185ff2e7cde2bd90fe9e4a90b7943, ASSIGN in 629 msec 2023-07-11 14:24:33,134 INFO [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 6a5aca3163b7bef744905773179c5d09 2023-07-11 14:24:33,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:24:33,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e 2023-07-11 14:24:33,137 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=551dbd676cfcd99c09597e9fc5285210, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:33,137 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473136"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473136"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473136"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473136"}]},"ts":"1689085473136"} 2023-07-11 14:24:33,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:24:33,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e 2023-07-11 14:24:33,139 DEBUG [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/colfamily11 2023-07-11 14:24:33,139 DEBUG [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/colfamily11 2023-07-11 14:24:33,139 INFO [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a5aca3163b7bef744905773179c5d09 columnFamilyName colfamily11 2023-07-11 14:24:33,140 INFO [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] regionserver.HStore(310): Store=6a5aca3163b7bef744905773179c5d09/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,141 INFO [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 6a5aca3163b7bef744905773179c5d09 2023-07-11 14:24:33,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,143 DEBUG [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/colfamily21 2023-07-11 14:24:33,143 DEBUG [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/colfamily21 2023-07-11 14:24:33,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:24:33,144 INFO [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a5aca3163b7bef744905773179c5d09 columnFamilyName colfamily21 2023-07-11 14:24:33,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=33 2023-07-11 14:24:33,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 937337250fe5f867c4822d687fa0330e 2023-07-11 14:24:33,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=33, state=SUCCESS; OpenRegionProcedure 551dbd676cfcd99c09597e9fc5285210, server=jenkins-hbase9.apache.org,36555,1689085468888 in 332 msec 2023-07-11 14:24:33,144 INFO [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] regionserver.HStore(310): Store=6a5aca3163b7bef744905773179c5d09/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,145 INFO [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 6a5aca3163b7bef744905773179c5d09 2023-07-11 14:24:33,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,146 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=551dbd676cfcd99c09597e9fc5285210, ASSIGN in 641 msec 2023-07-11 14:24:33,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ab932ae57850da80400237dc1b0b1b2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73746201, jitterRate=0.09890402853488922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ab932ae57850da80400237dc1b0b1b2f: 2023-07-11 14:24:33,147 DEBUG [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/colfamily31 2023-07-11 14:24:33,147 DEBUG [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/colfamily31 2023-07-11 14:24:33,148 INFO [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a5aca3163b7bef744905773179c5d09 columnFamilyName colfamily31 2023-07-11 14:24:33,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f., pid=42, masterSystemTime=1689085472827 2023-07-11 14:24:33,148 INFO [StoreOpener-6a5aca3163b7bef744905773179c5d09-1] regionserver.HStore(310): Store=6a5aca3163b7bef744905773179c5d09/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:24:33,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:24:33,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:24:33,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b5d115c3d662e11393952c37d76b9b1, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1.', STARTKEY => 'lll', ENDKEY => 'mmm'} 2023-07-11 14:24:33,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09 2023-07-11 14:24:33,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:24:33,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:24:33,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:24:33,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09 2023-07-11 14:24:33,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,153 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ab932ae57850da80400237dc1b0b1b2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:33,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 937337250fe5f867c4822d687fa0330e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65690450, jitterRate=-0.02113601565361023}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 937337250fe5f867c4822d687fa0330e: 2023-07-11 14:24:33,153 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473153"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473153"}]},"ts":"1689085473153"} 2023-07-11 14:24:33,154 INFO [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:24:33,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e., pid=53, masterSystemTime=1689085472884 2023-07-11 14:24:33,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,156 DEBUG [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/colfamily11 2023-07-11 14:24:33,156 DEBUG [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/colfamily11 2023-07-11 14:24:33,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:24:33,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:24:33,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:24:33,157 INFO [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b5d115c3d662e11393952c37d76b9b1 columnFamilyName colfamily11 2023-07-11 14:24:33,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a7a7878544668c682997c73147b1220, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2023-07-11 14:24:33,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 5a7a7878544668c682997c73147b1220 2023-07-11 14:24:33,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5a7a7878544668c682997c73147b1220 2023-07-11 14:24:33,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 6a5aca3163b7bef744905773179c5d09 2023-07-11 14:24:33,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5a7a7878544668c682997c73147b1220 2023-07-11 14:24:33,158 INFO [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] regionserver.HStore(310): Store=5b5d115c3d662e11393952c37d76b9b1/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,158 INFO [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:24:33,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=29 2023-07-11 14:24:33,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=29, state=SUCCESS; OpenRegionProcedure ab932ae57850da80400237dc1b0b1b2f, server=jenkins-hbase9.apache.org,42425,1689085468855 in 443 msec 2023-07-11 14:24:33,160 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 5a7a7878544668c682997c73147b1220 2023-07-11 14:24:33,161 DEBUG [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/colfamily21 2023-07-11 14:24:33,161 DEBUG [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/colfamily21 2023-07-11 14:24:33,162 INFO [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b5d115c3d662e11393952c37d76b9b1 columnFamilyName colfamily21 2023-07-11 14:24:33,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ab932ae57850da80400237dc1b0b1b2f, ASSIGN in 657 msec 2023-07-11 14:24:33,163 INFO [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] regionserver.HStore(310): Store=5b5d115c3d662e11393952c37d76b9b1/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,163 INFO [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:24:33,163 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily11 2023-07-11 14:24:33,163 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily11 2023-07-11 14:24:33,163 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=937337250fe5f867c4822d687fa0330e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:33,163 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a7a7878544668c682997c73147b1220 columnFamilyName colfamily11 2023-07-11 14:24:33,164 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473163"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473163"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473163"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473163"}]},"ts":"1689085473163"} 2023-07-11 14:24:33,164 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(310): Store=5a7a7878544668c682997c73147b1220/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,164 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 5a7a7878544668c682997c73147b1220 2023-07-11 14:24:33,166 DEBUG [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/colfamily31 2023-07-11 14:24:33,166 DEBUG [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/colfamily31 2023-07-11 14:24:33,166 INFO [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b5d115c3d662e11393952c37d76b9b1 columnFamilyName colfamily31 2023-07-11 14:24:33,167 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily21 2023-07-11 14:24:33,167 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily21 2023-07-11 14:24:33,167 INFO [StoreOpener-5b5d115c3d662e11393952c37d76b9b1-1] regionserver.HStore(310): Store=5b5d115c3d662e11393952c37d76b9b1/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,167 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a7a7878544668c682997c73147b1220 columnFamilyName colfamily21 2023-07-11 14:24:33,170 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(310): Store=5a7a7878544668c682997c73147b1220/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,171 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 5a7a7878544668c682997c73147b1220 2023-07-11 14:24:33,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:24:33,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=25 2023-07-11 14:24:33,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=25, state=SUCCESS; OpenRegionProcedure 937337250fe5f867c4822d687fa0330e, server=jenkins-hbase9.apache.org,38737,1689085468814 in 390 msec 2023-07-11 14:24:33,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 6a5aca3163b7bef744905773179c5d09; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75315300, jitterRate=0.12228542566299438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 6a5aca3163b7bef744905773179c5d09: 2023-07-11 14:24:33,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:24:33,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09., pid=60, masterSystemTime=1689085472936 2023-07-11 14:24:33,173 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily31 2023-07-11 14:24:33,173 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily31 2023-07-11 14:24:33,174 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a7a7878544668c682997c73147b1220 columnFamilyName colfamily31 2023-07-11 14:24:33,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=937337250fe5f867c4822d687fa0330e, ASSIGN in 671 msec 2023-07-11 14:24:33,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:24:33,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:24:33,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:24:33,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 66e7b46b2c70aaaa5ed558bcfa8ac676, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2023-07-11 14:24:33,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:24:33,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:24:33,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:24:33,176 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(310): Store=5a7a7878544668c682997c73147b1220/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,177 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6a5aca3163b7bef744905773179c5d09, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:33,177 INFO [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:24:33,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220 2023-07-11 14:24:33,177 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473177"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473177"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473177"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473177"}]},"ts":"1689085473177"} 2023-07-11 14:24:33,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220 2023-07-11 14:24:33,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:24:33,180 DEBUG [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/colfamily11 2023-07-11 14:24:33,180 DEBUG [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/colfamily11 2023-07-11 14:24:33,181 INFO [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66e7b46b2c70aaaa5ed558bcfa8ac676 columnFamilyName colfamily11 2023-07-11 14:24:33,182 INFO [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] regionserver.HStore(310): Store=66e7b46b2c70aaaa5ed558bcfa8ac676/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,182 INFO [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:24:33,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5b5d115c3d662e11393952c37d76b9b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72506556, jitterRate=0.08043187856674194}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5b5d115c3d662e11393952c37d76b9b1: 2023-07-11 14:24:33,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=16 2023-07-11 14:24:33,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=16, state=SUCCESS; OpenRegionProcedure 6a5aca3163b7bef744905773179c5d09, server=jenkins-hbase9.apache.org,36555,1689085468888 in 367 msec 2023-07-11 14:24:33,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1., pid=41, masterSystemTime=1689085472827 2023-07-11 14:24:33,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5a7a7878544668c682997c73147b1220 2023-07-11 14:24:33,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6a5aca3163b7bef744905773179c5d09, ASSIGN in 683 msec 2023-07-11 14:24:33,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:24:33,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:24:33,188 DEBUG [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/colfamily21 2023-07-11 14:24:33,188 DEBUG [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/colfamily21 2023-07-11 14:24:33,188 INFO [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66e7b46b2c70aaaa5ed558bcfa8ac676 columnFamilyName colfamily21 2023-07-11 14:24:33,189 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=5b5d115c3d662e11393952c37d76b9b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:33,189 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473189"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473189"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473189"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473189"}]},"ts":"1689085473189"} 2023-07-11 14:24:33,189 INFO [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] regionserver.HStore(310): Store=66e7b46b2c70aaaa5ed558bcfa8ac676/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,189 INFO [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:24:33,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5a7a7878544668c682997c73147b1220; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61563645, jitterRate=-0.0826302021741867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5a7a7878544668c682997c73147b1220: 2023-07-11 14:24:33,191 DEBUG [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/colfamily31 2023-07-11 14:24:33,192 DEBUG [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/colfamily31 2023-07-11 14:24:33,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220., pid=45, masterSystemTime=1689085472884 2023-07-11 14:24:33,193 INFO [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66e7b46b2c70aaaa5ed558bcfa8ac676 columnFamilyName colfamily31 2023-07-11 14:24:33,193 INFO [StoreOpener-66e7b46b2c70aaaa5ed558bcfa8ac676-1] regionserver.HStore(310): Store=66e7b46b2c70aaaa5ed558bcfa8ac676/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:24:33,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:24:33,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:24:33,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5931619e05cf0cf890fb2bcad4916149, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2023-07-11 14:24:33,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:24:33,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:24:33,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=21 2023-07-11 14:24:33,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:24:33,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:24:33,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=21, state=SUCCESS; OpenRegionProcedure 5b5d115c3d662e11393952c37d76b9b1, server=jenkins-hbase9.apache.org,42425,1689085468855 in 485 msec 2023-07-11 14:24:33,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:24:33,197 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:24:33,197 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5b5d115c3d662e11393952c37d76b9b1, ASSIGN in 694 msec 2023-07-11 14:24:33,198 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5a7a7878544668c682997c73147b1220, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:33,198 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473198"}]},"ts":"1689085473198"} 2023-07-11 14:24:33,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,199 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily11 2023-07-11 14:24:33,200 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily11 2023-07-11 14:24:33,200 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5931619e05cf0cf890fb2bcad4916149 columnFamilyName colfamily11 2023-07-11 14:24:33,201 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(310): Store=5931619e05cf0cf890fb2bcad4916149/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,201 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:24:33,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:24:33,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=12 2023-07-11 14:24:33,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=12, state=SUCCESS; OpenRegionProcedure 5a7a7878544668c682997c73147b1220, server=jenkins-hbase9.apache.org,38737,1689085468814 in 468 msec 2023-07-11 14:24:33,204 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily21 2023-07-11 14:24:33,204 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily21 2023-07-11 14:24:33,205 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5931619e05cf0cf890fb2bcad4916149 columnFamilyName colfamily21 2023-07-11 14:24:33,205 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(310): Store=5931619e05cf0cf890fb2bcad4916149/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5a7a7878544668c682997c73147b1220, ASSIGN in 702 msec 2023-07-11 14:24:33,206 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:24:33,207 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily31 2023-07-11 14:24:33,207 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily31 2023-07-11 14:24:33,208 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5931619e05cf0cf890fb2bcad4916149 columnFamilyName colfamily31 2023-07-11 14:24:33,208 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(310): Store=5931619e05cf0cf890fb2bcad4916149/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:24:33,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:24:33,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 66e7b46b2c70aaaa5ed558bcfa8ac676; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69324847, jitterRate=0.03302071988582611}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 66e7b46b2c70aaaa5ed558bcfa8ac676: 2023-07-11 14:24:33,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676., pid=61, masterSystemTime=1689085472936 2023-07-11 14:24:33,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:24:33,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:24:33,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:24:33,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd06cff512fea186a79c12a85e039c36, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2023-07-11 14:24:33,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true dd06cff512fea186a79c12a85e039c36 2023-07-11 14:24:33,215 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=66e7b46b2c70aaaa5ed558bcfa8ac676, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:33,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,215 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473215"}]},"ts":"1689085473215"} 2023-07-11 14:24:33,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for dd06cff512fea186a79c12a85e039c36 2023-07-11 14:24:33,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for dd06cff512fea186a79c12a85e039c36 2023-07-11 14:24:33,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:24:33,217 INFO [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region dd06cff512fea186a79c12a85e039c36 2023-07-11 14:24:33,219 DEBUG [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/colfamily11 2023-07-11 14:24:33,219 DEBUG [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/colfamily11 2023-07-11 14:24:33,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,219 INFO [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd06cff512fea186a79c12a85e039c36 columnFamilyName colfamily11 2023-07-11 14:24:33,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5931619e05cf0cf890fb2bcad4916149; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66639592, jitterRate=-0.006992697715759277}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5931619e05cf0cf890fb2bcad4916149: 2023-07-11 14:24:33,220 INFO [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] regionserver.HStore(310): Store=dd06cff512fea186a79c12a85e039c36/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,220 INFO [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region dd06cff512fea186a79c12a85e039c36 2023-07-11 14:24:33,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149., pid=52, masterSystemTime=1689085472884 2023-07-11 14:24:33,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=11 2023-07-11 14:24:33,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=11, state=SUCCESS; OpenRegionProcedure 66e7b46b2c70aaaa5ed558bcfa8ac676, server=jenkins-hbase9.apache.org,36555,1689085468888 in 400 msec 2023-07-11 14:24:33,222 DEBUG [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/colfamily21 2023-07-11 14:24:33,222 DEBUG [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/colfamily21 2023-07-11 14:24:33,223 INFO [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd06cff512fea186a79c12a85e039c36 columnFamilyName colfamily21 2023-07-11 14:24:33,224 INFO [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] regionserver.HStore(310): Store=dd06cff512fea186a79c12a85e039c36/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,224 INFO [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region dd06cff512fea186a79c12a85e039c36 2023-07-11 14:24:33,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:24:33,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:24:33,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=66e7b46b2c70aaaa5ed558bcfa8ac676, ASSIGN in 722 msec 2023-07-11 14:24:33,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:24:33,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c668c42743ec462b9ac68b0ac69bdad, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad.', STARTKEY => 'www', ENDKEY => 'xxx'} 2023-07-11 14:24:33,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:24:33,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:24:33,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:24:33,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5931619e05cf0cf890fb2bcad4916149, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:33,227 DEBUG [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/colfamily31 2023-07-11 14:24:33,227 DEBUG [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/colfamily31 2023-07-11 14:24:33,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473226"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473226"}]},"ts":"1689085473226"} 2023-07-11 14:24:33,227 INFO [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd06cff512fea186a79c12a85e039c36 columnFamilyName colfamily31 2023-07-11 14:24:33,228 INFO [StoreOpener-dd06cff512fea186a79c12a85e039c36-1] regionserver.HStore(310): Store=dd06cff512fea186a79c12a85e039c36/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,228 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:24:33,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36 2023-07-11 14:24:33,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36 2023-07-11 14:24:33,231 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily11 2023-07-11 14:24:33,231 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily11 2023-07-11 14:24:33,231 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c668c42743ec462b9ac68b0ac69bdad columnFamilyName colfamily11 2023-07-11 14:24:33,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=13 2023-07-11 14:24:33,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=13, state=SUCCESS; OpenRegionProcedure 5931619e05cf0cf890fb2bcad4916149, server=jenkins-hbase9.apache.org,38737,1689085468814 in 458 msec 2023-07-11 14:24:33,233 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(310): Store=6c668c42743ec462b9ac68b0ac69bdad/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,233 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:24:33,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5931619e05cf0cf890fb2bcad4916149, ASSIGN in 731 msec 2023-07-11 14:24:33,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,236 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily21 2023-07-11 14:24:33,236 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily21 2023-07-11 14:24:33,236 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c668c42743ec462b9ac68b0ac69bdad columnFamilyName colfamily21 2023-07-11 14:24:33,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for dd06cff512fea186a79c12a85e039c36 2023-07-11 14:24:33,237 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(310): Store=6c668c42743ec462b9ac68b0ac69bdad/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,237 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:24:33,239 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily31 2023-07-11 14:24:33,239 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily31 2023-07-11 14:24:33,240 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c668c42743ec462b9ac68b0ac69bdad columnFamilyName colfamily31 2023-07-11 14:24:33,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,240 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(310): Store=6c668c42743ec462b9ac68b0ac69bdad/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened dd06cff512fea186a79c12a85e039c36; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65440080, jitterRate=-0.024866819381713867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for dd06cff512fea186a79c12a85e039c36: 2023-07-11 14:24:33,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:24:33,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36., pid=54, masterSystemTime=1689085472936 2023-07-11 14:24:33,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:24:33,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:24:33,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:24:33,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:24:33,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff6d38721d77dec2555b77bfec573075, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2023-07-11 14:24:33,245 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=dd06cff512fea186a79c12a85e039c36, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:33,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true ff6d38721d77dec2555b77bfec573075 2023-07-11 14:24:33,245 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473245"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473245"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473245"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473245"}]},"ts":"1689085473245"} 2023-07-11 14:24:33,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:24:33,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ff6d38721d77dec2555b77bfec573075 2023-07-11 14:24:33,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ff6d38721d77dec2555b77bfec573075 2023-07-11 14:24:33,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,248 INFO [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region ff6d38721d77dec2555b77bfec573075 2023-07-11 14:24:33,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:24:33,250 DEBUG [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/colfamily11 2023-07-11 14:24:33,250 DEBUG [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/colfamily11 2023-07-11 14:24:33,251 INFO [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff6d38721d77dec2555b77bfec573075 columnFamilyName colfamily11 2023-07-11 14:24:33,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=20 2023-07-11 14:24:33,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=20, state=SUCCESS; OpenRegionProcedure dd06cff512fea186a79c12a85e039c36, server=jenkins-hbase9.apache.org,36555,1689085468888 in 464 msec 2023-07-11 14:24:33,251 INFO [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] regionserver.HStore(310): Store=ff6d38721d77dec2555b77bfec573075/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,252 INFO [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region ff6d38721d77dec2555b77bfec573075 2023-07-11 14:24:33,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=dd06cff512fea186a79c12a85e039c36, ASSIGN in 750 msec 2023-07-11 14:24:33,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 6c668c42743ec462b9ac68b0ac69bdad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67300589, jitterRate=0.002856925129890442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 6c668c42743ec462b9ac68b0ac69bdad: 2023-07-11 14:24:33,254 DEBUG [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/colfamily21 2023-07-11 14:24:33,254 DEBUG [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/colfamily21 2023-07-11 14:24:33,254 INFO [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff6d38721d77dec2555b77bfec573075 columnFamilyName colfamily21 2023-07-11 14:24:33,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad., pid=49, masterSystemTime=1689085472884 2023-07-11 14:24:33,255 INFO [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] regionserver.HStore(310): Store=ff6d38721d77dec2555b77bfec573075/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,255 INFO [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region ff6d38721d77dec2555b77bfec573075 2023-07-11 14:24:33,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:24:33,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:24:33,257 DEBUG [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/colfamily31 2023-07-11 14:24:33,257 DEBUG [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/colfamily31 2023-07-11 14:24:33,257 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=6c668c42743ec462b9ac68b0ac69bdad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:33,257 INFO [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff6d38721d77dec2555b77bfec573075 columnFamilyName colfamily31 2023-07-11 14:24:33,258 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473257"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473257"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473257"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473257"}]},"ts":"1689085473257"} 2023-07-11 14:24:33,258 INFO [StoreOpener-ff6d38721d77dec2555b77bfec573075-1] regionserver.HStore(310): Store=ff6d38721d77dec2555b77bfec573075/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:24:33,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075 2023-07-11 14:24:33,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075 2023-07-11 14:24:33,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=32 2023-07-11 14:24:33,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=32, state=SUCCESS; OpenRegionProcedure 6c668c42743ec462b9ac68b0ac69bdad, server=jenkins-hbase9.apache.org,38737,1689085468814 in 506 msec 2023-07-11 14:24:33,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:24:33,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ff6d38721d77dec2555b77bfec573075 2023-07-11 14:24:33,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6c668c42743ec462b9ac68b0ac69bdad, ASSIGN in 760 msec 2023-07-11 14:24:33,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 14:24:33,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ff6d38721d77dec2555b77bfec573075; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74091173, jitterRate=0.10404451191425323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:24:33,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ff6d38721d77dec2555b77bfec573075: 2023-07-11 14:24:33,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075., pid=57, masterSystemTime=1689085472936 2023-07-11 14:24:33,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:24:33,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:24:33,273 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ff6d38721d77dec2555b77bfec573075, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:33,273 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085473272"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085473272"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085473272"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085473272"}]},"ts":"1689085473272"} 2023-07-11 14:24:33,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=15 2023-07-11 14:24:33,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=15, state=SUCCESS; OpenRegionProcedure ff6d38721d77dec2555b77bfec573075, server=jenkins-hbase9.apache.org,36555,1689085468888 in 476 msec 2023-07-11 14:24:33,279 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=9 2023-07-11 14:24:33,279 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=ff6d38721d77dec2555b77bfec573075, ASSIGN in 776 msec 2023-07-11 14:24:33,281 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 14:24:33,281 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689085473281"}]},"ts":"1689085473281"} 2023-07-11 14:24:33,283 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, state=ENABLED in hbase:meta 2023-07-11 14:24:33,292 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 14:24:33,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true in 1.7090 sec 2023-07-11 14:24:33,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 14:24:33,719 INFO [Listener at localhost/44653] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, procId: 9 completed 2023-07-11 14:24:33,720 DEBUG [Listener at localhost/44653] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true get assigned. Timeout = 60000ms 2023-07-11 14:24:33,721 INFO [Listener at localhost/44653] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 14:24:33,727 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38737] regionserver.StoreScanner(1093): Switch to stream read (scanned=32940 bytes) of info 2023-07-11 14:24:33,740 INFO [Listener at localhost/44653] hbase.HBaseTestingUtility(3484): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned to meta. Checking AM states. 2023-07-11 14:24:33,741 INFO [Listener at localhost/44653] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 14:24:33,741 INFO [Listener at localhost/44653] hbase.HBaseTestingUtility(3504): All regions for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true assigned. 2023-07-11 14:24:33,880 DEBUG [hconnection-0x8db6223-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:24:33,884 DEBUG [hconnection-0x8db6223-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:24:33,933 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:24:33,938 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:24:33,947 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38737] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 5625 Client: jenkins//172.31.2.10 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:24:33,965 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36555] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 5624 Client: jenkins//172.31.2.10 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:24:33,968 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42425] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6327 Client: jenkins//172.31.2.10 first region in multi=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:24:34,127 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 14:24:34,139 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 14:24:34,148 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 14:24:34,156 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 14:24:34,165 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 14:24:34,171 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 14:24:34,176 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 14:24:34,182 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 14:24:34,186 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 14:24:34,190 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 14:24:34,194 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 14:24:34,200 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 14:24:34,205 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 14:24:34,211 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 14:24:34,217 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 14:24:34,221 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 14:24:34,226 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 14:24:34,232 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 14:24:34,236 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 14:24:34,242 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 14:24:34,248 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 14:24:34,254 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 14:24:34,260 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 14:24:34,265 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 14:24:34,270 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 14:24:34,278 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 14:24:34,284 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 14:24:34,289 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 14:24:34,295 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 14:24:34,300 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 14:24:34,305 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 14:24:34,311 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 14:24:34,317 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 14:24:34,321 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 14:24:34,325 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 14:24:34,329 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 14:24:34,335 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 14:24:34,340 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 14:24:34,345 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 14:24:34,351 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 14:24:34,357 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 14:24:34,362 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 14:24:34,366 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 14:24:34,371 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 14:24:34,377 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 14:24:34,380 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 14:24:34,385 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 14:24:34,390 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 14:24:34,393 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 14:24:34,397 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 14:24:34,669 WARN [Listener at localhost/44653] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: true 2023-07-11 14:24:34,669 INFO [Listener at localhost/44653] assignment.AssignmentTestingUtil(82): KILL REGION SERVER jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:34,669 INFO [Listener at localhost/44653] hbase.MiniHBaseCluster(271): Killing jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:34,672 ERROR [Listener at localhost/44653] helpers.MarkerIgnoringBase(143): ***** ABORTING region server jenkins-hbase9.apache.org,38737,1689085468814: Simulated kill ***** 2023-07-11 14:24:34,673 ERROR [Listener at localhost/44653] helpers.MarkerIgnoringBase(143): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2023-07-11 14:24:34,676 DEBUG [Listener at localhost/44653] util.JSONBean(130): Listing beans for java.lang:type=Memory 2023-07-11 14:24:34,679 DEBUG [Listener at localhost/44653] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=IPC 2023-07-11 14:24:34,680 DEBUG [Listener at localhost/44653] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Replication 2023-07-11 14:24:34,680 DEBUG [Listener at localhost/44653] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Server 2023-07-11 14:24:34,681 INFO [Listener at localhost/44653] regionserver.HRegionServer(2557): Dump of metrics as JSON on abort: { "beans": [ { "name": "java.lang:type=Memory", "modelerType": "sun.management.MemoryImpl", "Verbose": false, "ObjectPendingFinalizationCount": 0, "HeapMemoryUsage": { "committed": 989331456, "init": 513802240, "max": 2051014656, "used": 428351032 }, "NonHeapMemoryUsage": { "committed": 127361024, "init": 2555904, "max": -1, "used": 124930000 }, "ObjectName": "java.lang:type=Memory" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=IPC", "modelerType": "RegionServer,sub=IPC", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase9.apache.org" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Replication", "modelerType": "RegionServer,sub=Replication", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase9.apache.org" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Server", "modelerType": "RegionServer,sub=Server", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase9.apache.org" } ] } 2023-07-11 14:24:34,685 WARN [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33119] master.MasterRpcServices(612): jenkins-hbase9.apache.org,38737,1689085468814 reported a fatal error: ***** ABORTING region server jenkins-hbase9.apache.org,38737,1689085468814: Simulated kill ***** 2023-07-11 14:24:34,687 INFO [Listener at localhost/44653] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,38737,1689085468814' ***** 2023-07-11 14:24:34,688 INFO [Listener at localhost/44653] regionserver.HRegionServer(2311): STOPPED: Simulated kill 2023-07-11 14:24:34,688 INFO [RS:0;jenkins-hbase9:38737] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 14:24:34,688 INFO [RS:0;jenkins-hbase9:38737] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager abruptly. 2023-07-11 14:24:34,688 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 14:24:34,688 INFO [RS:0;jenkins-hbase9:38737] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager abruptly. 2023-07-11 14:24:34,688 INFO [Listener at localhost/44653] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 14:24:34,689 DEBUG [RS:0;jenkins-hbase9:38737] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16efbeef to 127.0.0.1:54666 2023-07-11 14:24:34,689 DEBUG [RS:0;jenkins-hbase9:38737] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:24:34,702 DEBUG [RS:0;jenkins-hbase9:38737] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:24:34,702 INFO [RS:0;jenkins-hbase9:38737] regionserver.LeaseManager(133): Closed leases 2023-07-11 14:24:34,703 INFO [RS:0;jenkins-hbase9:38737] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:38737 2023-07-11 14:24:34,712 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:34,712 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:24:34,712 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:24:34,712 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:34,712 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38737,1689085468814 2023-07-11 14:24:34,712 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:24:34,712 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:24:34,713 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,38737,1689085468814] 2023-07-11 14:24:34,714 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,38737,1689085468814; numProcessing=1 2023-07-11 14:24:34,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:34,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:34,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:34,717 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,38737,1689085468814 already deleted, retry=false 2023-07-11 14:24:34,717 INFO [RegionServerTracker-0] master.ServerManager(568): Processing expiration of jenkins-hbase9.apache.org,38737,1689085468814 on jenkins-hbase9.apache.org,33119,1689085467657 2023-07-11 14:24:34,717 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase9.apache.org,38737,1689085468814 znode expired, triggering replicatorRemoved event 2023-07-11 14:24:34,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:34,717 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase9.apache.org,38737,1689085468814 znode expired, triggering replicatorRemoved event 2023-07-11 14:24:34,719 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 14:24:34,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:34,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:24:34,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:34,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:24:34,725 DEBUG [RegionServerTracker-0] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:24:34,725 INFO [RegionServerTracker-0] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=62 for jenkins-hbase9.apache.org,38737,1689085468814 (carryingMeta=true) jenkins-hbase9.apache.org,38737,1689085468814/CRASHED/regionCount=11/lock=java.util.concurrent.locks.ReentrantReadWriteLock@55c4986f[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-11 14:24:34,728 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:24:34,728 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 14:24:34,728 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:24:34,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 14:24:34,728 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 14:24:34,789 INFO [Listener at localhost/44653] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 14:24:34,792 INFO [Listener at localhost/44653] procedure.MasterProcedureTestingUtility(454): Restart 0 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:24:34,793 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 14:24:34,793 INFO [Listener at localhost/44653] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 14:24:34,793 INFO [Listener at localhost/44653] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 14:24:34,795 ERROR [Listener at localhost/44653] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-07-11 14:24:34,796 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 14:24:34,796 INFO [Listener at localhost/44653] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 14:24:34,796 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 14:24:34,796 INFO [Listener at localhost/44653] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 14:24:34,797 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 14:24:34,801 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[] 2023-07-11 14:24:34,803 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 14:24:34,803 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 14:24:34,804 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 14:24:34,804 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 14:24:34,805 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 14:24:34,806 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:24:34,806 DEBUG [Listener at localhost/44653] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 14:24:34,806 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 9 msec 2023-07-11 14:24:34,807 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 14:24:34,807 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,38737,1689085468814, table=hbase:meta, region=1588230740 2023-07-11 14:24:34,809 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689085504809 2023-07-11 14:24:34,810 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 14:24:34,810 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=62, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:24:34,811 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 14:24:34,816 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:24:34,816 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:24:34,817 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true, isMeta: true 2023-07-11 14:24:34,820 DEBUG [PEWorker-1] master.MasterWalManager(318): Renamed region directory: hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting 2023-07-11 14:24:34,821 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38737,1689085468814 WAL count=1, meta=true 2023-07-11 14:24:34,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta}] 2023-07-11 14:24:34,826 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 14:24:34,826 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:24:34,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 14:24:34,826 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 14:24:34,891 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:24:34,892 INFO [RS:0;jenkins-hbase9:38737] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,38737,1689085468814; zookeeper connection closed. 2023-07-11 14:24:34,892 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:38737-0x10154b79c630001, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:24:34,893 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@193e60a3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@193e60a3 2023-07-11 14:24:34,922 DEBUG [hconnection-0x5012bb09-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:24:35,124 DEBUG [hconnection-0x5012bb09-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:24:35,173 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 14:24:35,173 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 14:24:35,426 DEBUG [hconnection-0x5012bb09-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:24:35,930 DEBUG [hconnection-0x5012bb09-shared-pool-5] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:24:36,109 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:24:36,178 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 14:24:36,179 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 14:24:36,180 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true' 2023-07-11 14:24:36,935 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:24:36,936 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:24:37,810 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 14:24:37,810 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 14:24:38,943 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:24:38,945 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:24:38,945 DEBUG [hconnection-0x5012bb09-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4130 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:24:42,955 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:24:42,957 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:24:42,957 DEBUG [hconnection-0x5012bb09-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8142 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:24:52,985 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:24:52,986 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:24:52,987 DEBUG [hconnection-0x5012bb09-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18171 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:03,004 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:03,005 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:25:03,005 DEBUG [hconnection-0x5012bb09-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28190 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:11,051 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase9.apache.org,38737,1689085468814 already deleted, retry=false 2023-07-11 14:25:12,997 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/replication/rs/jenkins-hbase9.apache.org,38737,1689085468814 already deleted, retry=false 2023-07-11 14:25:13,021 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:13,022 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:25:13,023 DEBUG [hconnection-0x5012bb09-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38207 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:23,098 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:23,099 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:25:23,099 DEBUG [hconnection-0x5012bb09-shared-pool-5] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48284 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:23,100 DEBUG [Listener at localhost/44653] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68462: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68462: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:23,101 WARN [Listener at localhost/44653] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-11T14:25:23.101Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68462: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68462: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:23,102 INFO [Listener at localhost/44653] procedure.MasterProcedureTestingUtility(454): Restart 1 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:25:23,102 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 14:25:23,102 INFO [Listener at localhost/44653] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 14:25:23,102 INFO [Listener at localhost/44653] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 14:25:23,103 ERROR [Listener at localhost/44653] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 14:25:23,103 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 14:25:23,103 INFO [Listener at localhost/44653] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 14:25:23,103 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 14:25:23,103 INFO [Listener at localhost/44653] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 14:25:23,105 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-11 14:25:23,107 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0] 2023-07-11 14:25:23,108 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 14:25:23,108 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 14:25:23,109 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 14:25:23,109 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 14:25:23,110 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 14:25:23,110 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:25:23,110 DEBUG [Listener at localhost/44653] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 14:25:23,110 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 4 msec 2023-07-11 14:25:23,111 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 14:25:23,111 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,38737,1689085468814, table=hbase:meta, region=1588230740 2023-07-11 14:25:23,113 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689085553113 2023-07-11 14:25:23,114 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 14:25:23,114 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true, isMeta: true 2023-07-11 14:25:23,118 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38737,1689085468814 WAL count=1, meta=true 2023-07-11 14:25:23,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta}] 2023-07-11 14:25:23,118 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 14:25:23,121 DEBUG [hconnection-0x5012bb09-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:25:23,129 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:25:23,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=64, ppid=63, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:25:23,222 DEBUG [hconnection-0x5012bb09-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:25:23,295 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42425] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=64 2023-07-11 14:25:23,319 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(300): Splitting hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, size=54.9 K (56255bytes) 2023-07-11 14:25:23,320 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta 2023-07-11 14:25:23,324 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta after 4ms 2023-07-11 14:25:23,332 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(311): Open hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta took 14ms 2023-07-11 14:25:23,347 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for 1588230740: last_flushed_sequence_id: 18446744073709551615 2023-07-11 14:25:23,356 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-2] util.CommonFSUtils$DfsBuilderUtility(753): Could not find replicate method on builder; will not set replicate when creating output stream java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DistributedFileSystem$HdfsDataOutputStreamBuilder.replicate() at java.lang.Class.getMethod(Class.java:1786) at org.apache.hadoop.hbase.util.CommonFSUtils$DfsBuilderUtility.(CommonFSUtils.java:750) at org.apache.hadoop.hbase.util.CommonFSUtils.createForWal(CommonFSUtils.java:802) at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter.initOutput(ProtobufLogWriter.java:102) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:78) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.createRecoveredEditsWriter(WALFactory.java:402) at org.apache.hadoop.hbase.wal.WALSplitter.createWriter(WALSplitter.java:516) at org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink.createRecoveredEditsWriter(AbstractRecoveredEditsOutputSink.java:69) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.getRecoveredEditsWriter(RecoveredEditsOutputSink.java:81) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.append(RecoveredEditsOutputSink.java:63) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.writeBuffer(OutputSink.java:249) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.doRun(OutputSink.java:241) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.run(OutputSink.java:211) 2023-07-11 14:25:23,357 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(400): Finishing writing output for hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta so closing down 2023-07-11 14:25:23,357 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-11 14:25:23,359 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta.temp 2023-07-11 14:25:23,363 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.OutputSink(146): 3 split writer threads finished 2023-07-11 14:25:23,383 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta.temp (wrote 60 edits, skipped 0 edits in 2 ms) 2023-07-11 14:25:23,385 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 14:25:23,385 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(423): Processed 61 edits across 1 Regions in 52 ms; skipped=1; WAL=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, size=54.9 K, length=56255, corrupted=false, cancelled=false 2023-07-11 14:25:23,385 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(426): Completed split of hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, journal: Splitting hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, size=54.9 K (56255bytes) at 1689085523319Finishing writing output for hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta so closing down at 1689085523357 (+38 ms)Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta.temp at 1689085523359 (+2 ms)3 split writer threads finished at 1689085523363 (+4 ms)Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta.temp (wrote 60 edits, skipped 0 edits in 2 ms) at 1689085523383 (+20 ms)Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 at 1689085523385 (+2 ms)Processed 61 edits across 1 Regions in 52 ms; skipped=1; WAL=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, size=54.9 K, length=56255, corrupted=false, cancelled=false at 1689085523385 2023-07-11 14:25:23,386 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta 2023-07-11 14:25:23,388 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=64 2023-07-11 14:25:23,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] master.HMaster(3641): Remote procedure done, pid=64 2023-07-11 14:25:23,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] wal.WALSplitUtil(141): Moved hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/oldWALs 2023-07-11 14:25:23,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=64, resume processing ppid=63 2023-07-11 14:25:23,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 in 267 msec 2023-07-11 14:25:23,399 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:25:23,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=62 2023-07-11 14:25:23,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 in 282 msec 2023-07-11 14:25:23,404 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting dir is empty, no logs to split. 2023-07-11 14:25:23,404 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38737,1689085468814 WAL count=0, meta=true 2023-07-11 14:25:23,404 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase9.apache.org,38737,1689085468814 WAL splitting is done? wals=0, meta=true 2023-07-11 14:25:23,404 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 14:25:23,404 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:25:23,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 14:25:23,404 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 14:25:23,425 DEBUG [hconnection-0x5012bb09-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:25:23,727 DEBUG [hconnection-0x5012bb09-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:25:24,230 DEBUG [hconnection-0x5012bb09-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:25:25,239 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:25,240 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:25:27,259 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:27,261 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:25:27,261 DEBUG [hconnection-0x5012bb09-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4141 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:31,300 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:31,301 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:25:31,301 DEBUG [hconnection-0x5012bb09-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8181 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:41,347 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:41,348 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:25:41,348 DEBUG [hconnection-0x5012bb09-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18228 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:51,362 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:25:51,363 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:25:51,363 DEBUG [hconnection-0x5012bb09-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28243 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:01,458 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:01,459 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:26:01,459 DEBUG [hconnection-0x5012bb09-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38339 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:11,516 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:11,517 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:26:11,517 DEBUG [hconnection-0x5012bb09-shared-pool-6] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48397 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:11,517 DEBUG [Listener at localhost/44653] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68481: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68481: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:11,518 WARN [Listener at localhost/44653] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-11T14:26:11.518Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68481: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68481: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:11,519 INFO [Listener at localhost/44653] procedure.MasterProcedureTestingUtility(454): Restart 2 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:26:11,519 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 14:26:11,519 INFO [Listener at localhost/44653] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 14:26:11,519 INFO [Listener at localhost/44653] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 14:26:11,519 ERROR [Listener at localhost/44653] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 14:26:11,519 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 14:26:11,519 INFO [Listener at localhost/44653] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 14:26:11,519 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 14:26:11,519 INFO [Listener at localhost/44653] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 14:26:11,521 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 14:26:11,523 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1] 2023-07-11 14:26:11,523 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 14:26:11,523 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 14:26:11,524 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 14:26:11,524 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 14:26:11,525 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 14:26:11,525 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 14:26:11,526 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 14:26:11,527 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:26:11,527 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:26:11,527 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:26:11,527 DEBUG [Listener at localhost/44653] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_META_WALS_DIR; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 14:26:11,527 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:26:11,528 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:26:11,528 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 6 msec 2023-07-11 14:26:11,528 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 14:26:11,529 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,38737,1689085468814, table=hbase:meta, region=1588230740 2023-07-11 14:26:11,529 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689085601529 2023-07-11 14:26:11,529 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 14:26:11,532 DEBUG [hconnection-0x5012bb09-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:26:11,533 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting dir is empty, no logs to split. 2023-07-11 14:26:11,533 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38737,1689085468814 WAL count=0, meta=true 2023-07-11 14:26:11,533 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase9.apache.org,38737,1689085468814 WAL splitting is done? wals=0, meta=true 2023-07-11 14:26:11,533 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 14:26:11,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 14:26:11,535 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 14:26:11,535 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:26:11,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 14:26:11,535 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 14:26:11,634 DEBUG [hconnection-0x5012bb09-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:26:11,836 DEBUG [hconnection-0x5012bb09-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:26:12,139 DEBUG [hconnection-0x5012bb09-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:26:12,641 DEBUG [hconnection-0x5012bb09-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:26:13,643 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:13,644 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:26:15,646 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:15,647 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:26:15,647 DEBUG [hconnection-0x5012bb09-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=46, started=4115 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:19,680 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:19,681 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:26:19,681 DEBUG [hconnection-0x5012bb09-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=7, retries=46, started=8149 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:29,722 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:29,723 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:26:29,724 DEBUG [hconnection-0x5012bb09-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=8, retries=46, started=18191 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:33,066 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-07-11 14:26:39,726 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:39,728 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:26:39,728 DEBUG [hconnection-0x5012bb09-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=9, retries=46, started=28196 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:49,775 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:49,776 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:26:49,776 DEBUG [hconnection-0x5012bb09-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=10, retries=46, started=38244 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:59,806 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:59,807 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:26:59,808 DEBUG [hconnection-0x5012bb09-shared-pool-7] client.RpcRetryingCallerImpl(129): Call exception, tries=11, retries=46, started=48276 ms ago, cancelled=false, msg=Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737, details=row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1, see https://s.apache.org/timeout, exception=java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:59,809 DEBUG [Listener at localhost/44653] client.ResultBoundedCompletionService(216): Replica 0 returns java.net.SocketTimeoutException: callTimeout=60000, callDuration=68276: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 java.net.SocketTimeoutException: callTimeout=60000, callDuration=68276: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:59,811 WARN [Listener at localhost/44653] procedure.MasterProcedureTestingUtility$3(120): Failed to load meta org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=46, exceptions: 2023-07-11T14:26:59.810Z, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68276: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:293) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:249) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:53) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:266) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:435) at org.apache.hadoop.hbase.client.ClientScanner.nextWithSyncCache(ClientScanner.java:309) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:594) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:806) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:755) at org.apache.hadoop.hbase.MetaTableAccessor.scanMeta(MetaTableAccessor.java:716) at org.apache.hadoop.hbase.MetaTableAccessor.fullScanRegions(MetaTableAccessor.java:193) at org.apache.hadoop.hbase.master.assignment.RegionStateStore.visitMeta(RegionStateStore.java:85) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.loadMeta(AssignmentManager.java:1651) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.joinCluster(AssignmentManager.java:1522) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:116) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility$3.call(MasterProcedureTestingUtility.java:111) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:143) at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:80) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:458) at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.testRecoveryAndDoubleExecution(MasterProcedureTestingUtility.java:467) at org.apache.hadoop.hbase.master.procedure.TestSCPBase.testRecoveryAndDoubleExecution(TestSCPBase.java:114) at org.apache.hadoop.hbase.master.procedure.TestSCPWithMeta.testRecoveryAndDoubleExecutionOnRsWithMeta(TestSCPWithMeta.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68276: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=jenkins-hbase9.apache.org,38737,1689085468814, seqNum=-1 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more Caused by: java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:38737 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:26:59,811 INFO [Listener at localhost/44653] procedure.MasterProcedureTestingUtility(454): Restart 3 exec state=pid=62, state=WAITING:SERVER_CRASH_GET_REGIONS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:26:59,811 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 14:26:59,811 INFO [Listener at localhost/44653] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 14:26:59,812 INFO [Listener at localhost/44653] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 14:26:59,812 ERROR [Listener at localhost/44653] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 14:26:59,812 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 14:26:59,812 INFO [Listener at localhost/44653] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 14:26:59,812 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 14:26:59,812 INFO [Listener at localhost/44653] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 14:26:59,814 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 14:26:59,815 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7] 2023-07-11 14:26:59,815 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 14:26:59,815 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 14:26:59,816 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 14:26:59,826 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 14:26:59,827 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 14:26:59,827 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 14:26:59,829 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 14:26:59,830 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:26:59,830 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:26:59,830 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:26:59,830 DEBUG [Listener at localhost/44653] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN_META; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 14:26:59,830 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:26:59,830 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:26:59,830 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 16 msec 2023-07-11 14:26:59,839 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 14:26:59,840 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,38737,1689085468814, table=hbase:meta, region=1588230740 2023-07-11 14:26:59,845 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689085649845 2023-07-11 14:26:59,847 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 14:26:59,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 14:26:59,847 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 14:26:59,850 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 14:26:59,851 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=65, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 14:26:59,852 DEBUG [hconnection-0x5012bb09-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:26:59,954 DEBUG [hconnection-0x5012bb09-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:27:00,001 DEBUG [jenkins-hbase9:33119] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-07-11 14:27:00,002 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 14:27:00,002 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 14:27:00,002 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 14:27:00,002 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 14:27:00,003 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,42425,1689085468855, state=OPENING 2023-07-11 14:27:00,005 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 14:27:00,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:27:00,005 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 14:27:00,157 WARN [ReadOnlyZKClient-127.0.0.1:54666@0x6c8b3845] client.ZKConnectionRegistry(168): Meta region is in state OPENING 2023-07-11 14:27:00,157 DEBUG [hconnection-0x5012bb09-shared-pool-8] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 14:27:00,161 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:27:00,163 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42425] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Scan size: 97 connection: 172.31.2.10:41974 deadline: 1689085679857, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:00,167 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 14:27:00,167 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 14:27:00,170 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C42425%2C1689085468855.meta, suffix=.meta, logDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,42425,1689085468855, archiveDir=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/oldWALs, maxLogs=32 2023-07-11 14:27:00,197 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK] 2023-07-11 14:27:00,198 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK] 2023-07-11 14:27:00,202 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK] 2023-07-11 14:27:00,214 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,42425,1689085468855/jenkins-hbase9.apache.org%2C42425%2C1689085468855.meta.1689085620172.meta 2023-07-11 14:27:00,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34617,DS-7b070e65-aeee-4fe9-8c03-73073d5f2dbf,DISK], DatanodeInfoWithStorage[127.0.0.1:40265,DS-9dc9435f-4ccd-4023-a7c6-8a6963fd56f3,DISK], DatanodeInfoWithStorage[127.0.0.1:41791,DS-b2db6e21-4ef0-4575-ae5c-d33e71152a39,DISK]] 2023-07-11 14:27:00,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:27:00,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 14:27:00,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 14:27:00,216 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 14:27:00,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 14:27:00,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:27:00,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 14:27:00,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 14:27:00,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 14:27:00,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/info 2023-07-11 14:27:00,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/info 2023-07-11 14:27:00,220 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 14:27:00,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:00,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 14:27:00,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/rep_barrier 2023-07-11 14:27:00,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/rep_barrier 2023-07-11 14:27:00,223 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 14:27:00,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:00,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 14:27:00,225 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/table 2023-07-11 14:27:00,225 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/table 2023-07-11 14:27:00,226 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 14:27:00,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:00,227 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740 2023-07-11 14:27:00,229 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740 2023-07-11 14:27:00,230 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 14:27:00,243 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 274, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=63, path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 14:27:00,244 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=51.43 KB heapSize=72.08 KB 2023-07-11 14:27:00,307 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=51.14 KB at sequenceid=63 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/.tmp/info/e88d569951ac4af5b5668a808fb5e58c 2023-07-11 14:27:00,366 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=296 B at sequenceid=63 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/.tmp/table/72732eaeb1ec49acbe31d7ccd290971c 2023-07-11 14:27:00,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/.tmp/info/e88d569951ac4af5b5668a808fb5e58c as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/info/e88d569951ac4af5b5668a808fb5e58c 2023-07-11 14:27:00,382 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/info/e88d569951ac4af5b5668a808fb5e58c, entries=270, sequenceid=63, filesize=57.3 K 2023-07-11 14:27:00,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/.tmp/table/72732eaeb1ec49acbe31d7ccd290971c as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/table/72732eaeb1ec49acbe31d7ccd290971c 2023-07-11 14:27:00,395 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/table/72732eaeb1ec49acbe31d7ccd290971c, entries=4, sequenceid=63, filesize=4.9 K 2023-07-11 14:27:00,395 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~51.43 KB/52664, heapSize ~71.80 KB/73520, currentSize=0 B/0 for 1588230740 in 152ms, sequenceid=63, compaction requested=false; wal=null 2023-07-11 14:27:00,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/0000000000000000063 2023-07-11 14:27:00,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:27:00,403 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 14:27:00,405 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/63.seqid, newMaxSeqId=63, maxSeqId=1 2023-07-11 14:27:00,407 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=64; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74635231, jitterRate=0.1121516078710556}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:27:00,407 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 14:27:00,410 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=66, masterSystemTime=1689085620158 2023-07-11 14:27:00,411 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 14:27:00,411 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 14:27:00,412 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,42425,1689085468855, state=OPEN 2023-07-11 14:27:00,413 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 14:27:00,413 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 14:27:00,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-07-11 14:27:00,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855 in 408 msec 2023-07-11 14:27:00,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=65, resume processing ppid=62 2023-07-11 14:27:00,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 568 msec 2023-07-11 14:27:00,518 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=3300b91b6685c56113c82e496565fd11, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,519 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d300c1c4be5195cf92faac67764ebb52, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,519 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=66e7b46b2c70aaaa5ed558bcfa8ac676, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,519 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5a7a7878544668c682997c73147b1220, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,520 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5931619e05cf0cf890fb2bcad4916149, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,520 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ed162f49432e859aa69b9277091322c6, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,520 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ff6d38721d77dec2555b77bfec573075, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,520 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6a5aca3163b7bef744905773179c5d09, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,521 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ac77e8e2fc5f54d54be1f5c59a7a3d24, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,521 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=82a6a2c5d8b4f8de1fbd3bdd41150dab, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,521 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d6012602a1d2ab18cd68f81a87b29d16, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,522 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=dd06cff512fea186a79c12a85e039c36, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,522 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5b5d115c3d662e11393952c37d76b9b1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,522 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=2d05c9e5bd88a0debf2d4f4cab371c23, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,523 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=88a55364cb44dcda432e2854a92e01b4, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,523 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6ae32d4e7367668541894e8f3c21c047, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,523 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=937337250fe5f867c4822d687fa0330e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,523 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=10dfb74a1a23ab15b405d903fdf243a0, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,524 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=98b0bf96f74236d0e5d66c8a4188e4cd, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,524 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=fdb423248dfa9ba3bd628e031d476892, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,524 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ab932ae57850da80400237dc1b0b1b2f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,525 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=a731373ce9dfd79d55495dd18431f095, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,525 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=22b1c0abb82e1750694628a9ed9bc56b, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,525 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6c668c42743ec462b9ac68b0ac69bdad, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,525 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=551dbd676cfcd99c09597e9fc5285210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,526 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ec820b7b1bea419174597c47a0865f47, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,526 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=bb4185ff2e7cde2bd90fe9e4a90b7943, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,526 INFO [Listener at localhost/44653] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 14:27:00,526 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689085680526 2023-07-11 14:27:00,526 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689085740526 2023-07-11 14:27:00,526 INFO [Listener at localhost/44653] assignment.AssignmentManager(1536): Joined the cluster in 679 msec 2023-07-11 14:27:00,527 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase9.apache.org,38737,1689085468814 had 11 regions 2023-07-11 14:27:00,527 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 14:27:00,527 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:00,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 14:27:00,527 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 14:27:00,777 INFO [Listener at localhost/44653] procedure.MasterProcedureTestingUtility(454): Restart 4 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:00,777 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 14:27:00,777 INFO [Listener at localhost/44653] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 14:27:00,777 INFO [Listener at localhost/44653] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 14:27:00,777 ERROR [Listener at localhost/44653] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 14:27:00,778 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 14:27:00,778 INFO [Listener at localhost/44653] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 14:27:00,778 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 14:27:00,778 INFO [Listener at localhost/44653] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 14:27:00,779 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 14:27:00,781 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14] 2023-07-11 14:27:00,782 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 14:27:00,782 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 14:27:00,782 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 14:27:00,782 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 14:27:00,782 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 14:27:00,783 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 14:27:00,783 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 14:27:00,783 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 14:27:00,784 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 14:27:00,785 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:00,786 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:00,786 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:00,786 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 14:27:00,786 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:00,786 DEBUG [Listener at localhost/44653] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 14:27:00,786 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:00,786 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:00,786 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:00,786 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:00,787 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 7 msec 2023-07-11 14:27:00,787 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 14:27:00,788 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,42425,1689085468855, table=hbase:meta, region=1588230740 2023-07-11 14:27:00,792 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689085650792 2023-07-11 14:27:00,792 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 14:27:00,811 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=3300b91b6685c56113c82e496565fd11, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,812 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d300c1c4be5195cf92faac67764ebb52, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,812 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=66e7b46b2c70aaaa5ed558bcfa8ac676, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,812 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5a7a7878544668c682997c73147b1220, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,812 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5931619e05cf0cf890fb2bcad4916149, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,813 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ed162f49432e859aa69b9277091322c6, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,813 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ff6d38721d77dec2555b77bfec573075, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,813 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6a5aca3163b7bef744905773179c5d09, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,813 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ac77e8e2fc5f54d54be1f5c59a7a3d24, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,814 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=82a6a2c5d8b4f8de1fbd3bdd41150dab, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,814 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d6012602a1d2ab18cd68f81a87b29d16, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,814 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=dd06cff512fea186a79c12a85e039c36, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,814 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5b5d115c3d662e11393952c37d76b9b1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,815 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=2d05c9e5bd88a0debf2d4f4cab371c23, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,815 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=88a55364cb44dcda432e2854a92e01b4, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,815 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6ae32d4e7367668541894e8f3c21c047, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,815 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=937337250fe5f867c4822d687fa0330e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,816 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=10dfb74a1a23ab15b405d903fdf243a0, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,816 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=98b0bf96f74236d0e5d66c8a4188e4cd, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,816 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=fdb423248dfa9ba3bd628e031d476892, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,816 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ab932ae57850da80400237dc1b0b1b2f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,817 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=a731373ce9dfd79d55495dd18431f095, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,817 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=22b1c0abb82e1750694628a9ed9bc56b, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,817 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6c668c42743ec462b9ac68b0ac69bdad, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,817 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=551dbd676cfcd99c09597e9fc5285210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:00,817 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ec820b7b1bea419174597c47a0865f47, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:00,818 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=bb4185ff2e7cde2bd90fe9e4a90b7943, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:00,818 INFO [Listener at localhost/44653] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 14:27:00,819 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689085680818 2023-07-11 14:27:00,819 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689085740819 2023-07-11 14:27:00,819 INFO [Listener at localhost/44653] assignment.AssignmentManager(1536): Joined the cluster in 27 msec 2023-07-11 14:27:00,820 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase9.apache.org,38737,1689085468814 had 10 regions 2023-07-11 14:27:00,820 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 14:27:00,821 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true, isMeta: false 2023-07-11 14:27:00,825 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38737,1689085468814 WAL count=1, meta=false 2023-07-11 14:27:00,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282}] 2023-07-11 14:27:00,825 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 14:27:00,825 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:00,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 14:27:00,825 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 14:27:01,070 INFO [Listener at localhost/44653] procedure.MasterProcedureTestingUtility(454): Restart 5 exec state=pid=62, state=WAITING:SERVER_CRASH_DELETE_SPLIT_WALS_DIR, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:01,070 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 14:27:01,070 INFO [Listener at localhost/44653] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 14:27:01,071 INFO [Listener at localhost/44653] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 14:27:01,071 ERROR [Listener at localhost/44653] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 14:27:01,071 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 14:27:01,071 INFO [Listener at localhost/44653] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 14:27:01,071 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 14:27:01,071 INFO [Listener at localhost/44653] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 14:27:01,072 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 14:27:01,074 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16] 2023-07-11 14:27:01,074 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 14:27:01,074 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 14:27:01,074 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 14:27:01,074 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 14:27:01,075 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 14:27:01,075 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 14:27:01,075 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 14:27:01,076 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 14:27:01,077 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 14:27:01,077 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:01,078 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:01,078 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:01,078 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 14:27:01,078 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:01,078 DEBUG [Listener at localhost/44653] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 14:27:01,078 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:01,078 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:01,078 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:01,079 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:01,079 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 6 msec 2023-07-11 14:27:01,080 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 14:27:01,082 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,42425,1689085468855, table=hbase:meta, region=1588230740 2023-07-11 14:27:01,094 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689085651094 2023-07-11 14:27:01,095 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 14:27:01,106 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=3300b91b6685c56113c82e496565fd11, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:01,106 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d300c1c4be5195cf92faac67764ebb52, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:01,107 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=66e7b46b2c70aaaa5ed558bcfa8ac676, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:01,107 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5a7a7878544668c682997c73147b1220, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:01,107 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5931619e05cf0cf890fb2bcad4916149, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:01,107 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ed162f49432e859aa69b9277091322c6, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:01,108 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ff6d38721d77dec2555b77bfec573075, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:01,108 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6a5aca3163b7bef744905773179c5d09, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:01,108 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ac77e8e2fc5f54d54be1f5c59a7a3d24, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:01,108 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=82a6a2c5d8b4f8de1fbd3bdd41150dab, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:01,109 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d6012602a1d2ab18cd68f81a87b29d16, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:01,109 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=dd06cff512fea186a79c12a85e039c36, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:01,109 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5b5d115c3d662e11393952c37d76b9b1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:01,109 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=2d05c9e5bd88a0debf2d4f4cab371c23, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:01,110 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=88a55364cb44dcda432e2854a92e01b4, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:01,110 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6ae32d4e7367668541894e8f3c21c047, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:01,110 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=937337250fe5f867c4822d687fa0330e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:01,110 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=10dfb74a1a23ab15b405d903fdf243a0, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:01,111 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=98b0bf96f74236d0e5d66c8a4188e4cd, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:01,111 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=fdb423248dfa9ba3bd628e031d476892, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:01,111 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ab932ae57850da80400237dc1b0b1b2f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:01,111 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=a731373ce9dfd79d55495dd18431f095, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:01,112 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=22b1c0abb82e1750694628a9ed9bc56b, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:01,112 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6c668c42743ec462b9ac68b0ac69bdad, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:01,112 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=551dbd676cfcd99c09597e9fc5285210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:01,112 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ec820b7b1bea419174597c47a0865f47, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:01,113 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=bb4185ff2e7cde2bd90fe9e4a90b7943, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:01,113 INFO [Listener at localhost/44653] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 14:27:01,113 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689085681113 2023-07-11 14:27:01,113 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689085741113 2023-07-11 14:27:01,113 INFO [Listener at localhost/44653] assignment.AssignmentManager(1536): Joined the cluster in 17 msec 2023-07-11 14:27:01,113 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=62, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true, isMeta: false 2023-07-11 14:27:01,116 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38737,1689085468814 WAL count=1, meta=false 2023-07-11 14:27:01,116 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282}] 2023-07-11 14:27:01,116 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 14:27:01,119 DEBUG [PEWorker-1] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:01,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:27:01,275 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42425] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=68 2023-07-11 14:27:01,290 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(300): Splitting hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, size=292.0 K (299047bytes) 2023-07-11 14:27:01,290 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282 2023-07-11 14:27:01,291 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282 after 1ms 2023-07-11 14:27:01,296 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(311): Open hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282 took 6ms 2023-07-11 14:27:01,302 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(346): Last flushed sequenceid for 3300b91b6685c56113c82e496565fd11: last_flushed_sequence_id: 18446744073709551615 2023-07-11 14:27:01,304 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(346): Last flushed sequenceid for 2d05c9e5bd88a0debf2d4f4cab371c23: last_flushed_sequence_id: 18446744073709551615 2023-07-11 14:27:01,305 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(346): Last flushed sequenceid for fdb423248dfa9ba3bd628e031d476892: last_flushed_sequence_id: 18446744073709551615 2023-07-11 14:27:01,306 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp 2023-07-11 14:27:01,306 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(346): Last flushed sequenceid for d6012602a1d2ab18cd68f81a87b29d16: last_flushed_sequence_id: 18446744073709551615 2023-07-11 14:27:01,307 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(346): Last flushed sequenceid for 82a6a2c5d8b4f8de1fbd3bdd41150dab: last_flushed_sequence_id: 18446744073709551615 2023-07-11 14:27:01,308 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(346): Last flushed sequenceid for bb4185ff2e7cde2bd90fe9e4a90b7943: last_flushed_sequence_id: 18446744073709551615 2023-07-11 14:27:01,309 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(346): Last flushed sequenceid for 937337250fe5f867c4822d687fa0330e: last_flushed_sequence_id: 18446744073709551615 2023-07-11 14:27:01,310 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(346): Last flushed sequenceid for 5a7a7878544668c682997c73147b1220: last_flushed_sequence_id: 18446744073709551615 2023-07-11 14:27:01,312 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(346): Last flushed sequenceid for 5931619e05cf0cf890fb2bcad4916149: last_flushed_sequence_id: 18446744073709551615 2023-07-11 14:27:01,312 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(346): Last flushed sequenceid for 6c668c42743ec462b9ac68b0ac69bdad: last_flushed_sequence_id: 18446744073709551615 2023-07-11 14:27:01,317 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp 2023-07-11 14:27:01,330 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(400): Finishing writing output for hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282 so closing down 2023-07-11 14:27:01,330 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-11 14:27:01,332 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp 2023-07-11 14:27:01,332 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp 2023-07-11 14:27:01,332 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp 2023-07-11 14:27:01,346 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp 2023-07-11 14:27:01,347 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp 2023-07-11 14:27:01,347 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp 2023-07-11 14:27:01,351 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp 2023-07-11 14:27:01,353 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp 2023-07-11 14:27:01,354 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.OutputSink(146): 3 split writer threads finished 2023-07-11 14:27:01,450 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-11 14:27:01,452 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 2 ms) 2023-07-11 14:27:01,453 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/0000000000000000004 2023-07-11 14:27:01,456 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/0000000000000000004 2023-07-11 14:27:01,478 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 14:27:01,478 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 2 edits, skipped 0 edits in 0 ms) 2023-07-11 14:27:01,480 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/0000000000000000005 2023-07-11 14:27:01,481 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/0000000000000000004 2023-07-11 14:27:01,504 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 2 ms) 2023-07-11 14:27:01,504 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 2 ms) 2023-07-11 14:27:01,506 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/0000000000000000004 2023-07-11 14:27:01,507 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/0000000000000000004 2023-07-11 14:27:01,527 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 2 ms) 2023-07-11 14:27:01,528 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 1 ms) 2023-07-11 14:27:01,530 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/0000000000000000004 2023-07-11 14:27:01,530 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/0000000000000000004 2023-07-11 14:27:01,543 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 14:27:01,545 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/0000000000000000004 2023-07-11 14:27:01,859 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 14:27:01,860 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/0000000000000000004 2023-07-11 14:27:01,861 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(423): Processed 21 edits across 10 Regions in 562 ms; skipped=10; WAL=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, size=292.0 K, length=299047, corrupted=false, cancelled=false 2023-07-11 14:27:01,861 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] wal.WALSplitter(426): Completed split of hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, journal: Splitting hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, size=292.0 K (299047bytes) at 1689085621290Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp at 1689085621306 (+16 ms)Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp at 1689085621317 (+11 ms)Finishing writing output for hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282 so closing down at 1689085621330 (+13 ms)Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp at 1689085621332 (+2 ms)Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp at 1689085621332Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp at 1689085621332Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp at 1689085621346 (+14 ms)Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp at 1689085621347 (+1 ms)Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp at 1689085621347Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp at 1689085621351 (+4 ms)Creating recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp at 1689085621354 (+3 ms)3 split writer threads finished at 1689085621354Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689085621450 (+96 ms)Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 2 ms) at 1689085621453 (+3 ms)Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/0000000000000000004 at 1689085621453Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/0000000000000000004 at 1689085621456 (+3 ms)Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689085621478 (+22 ms)Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 2 edits, skipped 0 edits in 0 ms) at 1689085621478Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/0000000000000000005 at 1689085621480 (+2 ms)Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/0000000000000000004 at 1689085621482 (+2 ms)Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 2 ms) at 1689085621504 (+22 ms)Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 2 ms) at 1689085621504Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/0000000000000000004 at 1689085621506 (+2 ms)Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/0000000000000000004 at 1689085621507 (+1 ms)Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 2 ms) at 1689085621527 (+20 ms)Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 1 ms) at 1689085621528 (+1 ms)Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/0000000000000000004 at 1689085621530 (+2 ms)Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/0000000000000000004 at 1689085621530Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689085621543 (+13 ms)Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/0000000000000000004 at 1689085621545 (+2 ms)Closed recovered edits writer path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689085621859 (+314 ms)Rename recovered edits hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/0000000000000000004-jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282.temp to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/0000000000000000004 at 1689085621860 (+1 ms)Processed 21 edits across 10 Regions in 562 ms; skipped=10; WAL=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, size=292.0 K, length=299047, corrupted=false, cancelled=false at 1689085621861 (+1 ms) 2023-07-11 14:27:01,861 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282 2023-07-11 14:27:01,861 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-1] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=68 2023-07-11 14:27:01,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] master.HMaster(3641): Remote procedure done, pid=68 2023-07-11 14:27:01,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33119] wal.WALSplitUtil(141): Moved hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting/jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282 to hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/oldWALs 2023-07-11 14:27:01,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-07-11 14:27:01,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 in 746 msec 2023-07-11 14:27:01,871 DEBUG [PEWorker-1] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:01,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=62 2023-07-11 14:27:01,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 in 755 msec 2023-07-11 14:27:01,875 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting dir is empty, no logs to split. 2023-07-11 14:27:01,875 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38737,1689085468814 WAL count=0, meta=false 2023-07-11 14:27:01,875 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase9.apache.org,38737,1689085468814 WAL splitting is done? wals=0, meta=false 2023-07-11 14:27:01,876 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 14:27:01,876 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:01,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 14:27:01,876 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 14:27:02,116 INFO [Listener at localhost/44653] procedure.MasterProcedureTestingUtility(454): Restart 6 exec state=pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:02,116 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 14:27:02,116 INFO [Listener at localhost/44653] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 14:27:02,116 INFO [Listener at localhost/44653] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 14:27:02,117 ERROR [Listener at localhost/44653] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 14:27:02,117 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 14:27:02,117 INFO [Listener at localhost/44653] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 14:27:02,117 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 14:27:02,117 INFO [Listener at localhost/44653] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 14:27:02,118 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 14:27:02,119 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18] 2023-07-11 14:27:02,119 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 14:27:02,120 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 14:27:02,120 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-11 14:27:02,120 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-11 14:27:02,120 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 14:27:02,120 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 14:27:02,120 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 14:27:02,121 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 14:27:02,121 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 14:27:02,121 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 14:27:02,122 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 14:27:02,123 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:02,123 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,123 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,123 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 14:27:02,123 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,123 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,123 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,123 DEBUG [Listener at localhost/44653] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_DELETE_SPLIT_WALS_DIR; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 14:27:02,123 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,124 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,124 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,124 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,124 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,124 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,124 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-11 14:27:02,125 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 14:27:02,125 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,42425,1689085468855, table=hbase:meta, region=1588230740 2023-07-11 14:27:02,125 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689085652125 2023-07-11 14:27:02,126 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 14:27:02,131 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=3300b91b6685c56113c82e496565fd11, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,131 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d300c1c4be5195cf92faac67764ebb52, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,131 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=66e7b46b2c70aaaa5ed558bcfa8ac676, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,131 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5a7a7878544668c682997c73147b1220, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,131 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5931619e05cf0cf890fb2bcad4916149, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,131 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ed162f49432e859aa69b9277091322c6, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,132 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ff6d38721d77dec2555b77bfec573075, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,132 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6a5aca3163b7bef744905773179c5d09, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,132 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ac77e8e2fc5f54d54be1f5c59a7a3d24, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,132 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=82a6a2c5d8b4f8de1fbd3bdd41150dab, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,132 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d6012602a1d2ab18cd68f81a87b29d16, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,132 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=dd06cff512fea186a79c12a85e039c36, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,132 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5b5d115c3d662e11393952c37d76b9b1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,132 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=2d05c9e5bd88a0debf2d4f4cab371c23, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,133 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=88a55364cb44dcda432e2854a92e01b4, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,133 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6ae32d4e7367668541894e8f3c21c047, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,133 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=937337250fe5f867c4822d687fa0330e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,133 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=10dfb74a1a23ab15b405d903fdf243a0, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,133 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=98b0bf96f74236d0e5d66c8a4188e4cd, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,133 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=fdb423248dfa9ba3bd628e031d476892, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,133 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ab932ae57850da80400237dc1b0b1b2f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,133 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=a731373ce9dfd79d55495dd18431f095, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,134 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=22b1c0abb82e1750694628a9ed9bc56b, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,134 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6c668c42743ec462b9ac68b0ac69bdad, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,134 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=551dbd676cfcd99c09597e9fc5285210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,134 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ec820b7b1bea419174597c47a0865f47, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,134 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=bb4185ff2e7cde2bd90fe9e4a90b7943, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,134 INFO [Listener at localhost/44653] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 14:27:02,134 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689085682134 2023-07-11 14:27:02,134 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689085742134 2023-07-11 14:27:02,134 INFO [Listener at localhost/44653] assignment.AssignmentManager(1536): Joined the cluster in 8 msec 2023-07-11 14:27:02,136 INFO [PEWorker-1] master.MasterWalManager(320): Log dir for server jenkins-hbase9.apache.org,38737,1689085468814 does not exist 2023-07-11 14:27:02,136 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase9.apache.org,38737,1689085468814 WAL count=0, meta=false 2023-07-11 14:27:02,136 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase9.apache.org,38737,1689085468814 WAL splitting is done? wals=0, meta=false 2023-07-11 14:27:02,137 INFO [PEWorker-1] procedure.ServerCrashProcedure(282): Remove WAL directory for jenkins-hbase9.apache.org,38737,1689085468814 failed, ignore...File hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/WALs/jenkins-hbase9.apache.org,38737,1689085468814-splitting does not exist. 2023-07-11 14:27:02,137 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 14:27:02,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2d05c9e5bd88a0debf2d4f4cab371c23, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=937337250fe5f867c4822d687fa0330e, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6c668c42743ec462b9ac68b0ac69bdad, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdb423248dfa9ba3bd628e031d476892, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3300b91b6685c56113c82e496565fd11, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5931619e05cf0cf890fb2bcad4916149, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=82a6a2c5d8b4f8de1fbd3bdd41150dab, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb4185ff2e7cde2bd90fe9e4a90b7943, ASSIGN}, {pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d6012602a1d2ab18cd68f81a87b29d16, ASSIGN}, {pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5a7a7878544668c682997c73147b1220, ASSIGN}] 2023-07-11 14:27:02,139 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 14:27:02,139 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:02,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 14:27:02,139 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 14:27:02,385 INFO [Listener at localhost/44653] procedure.MasterProcedureTestingUtility(454): Restart 7 exec state=pid=62, state=WAITING:SERVER_CRASH_FINISH, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:02,385 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 14:27:02,385 INFO [Listener at localhost/44653] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 14:27:02,385 INFO [Listener at localhost/44653] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 14:27:02,385 ERROR [Listener at localhost/44653] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 14:27:02,385 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 14:27:02,385 INFO [Listener at localhost/44653] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 14:27:02,385 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 14:27:02,386 INFO [Listener at localhost/44653] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 14:27:02,386 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 14:27:02,387 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25] 2023-07-11 14:27:02,387 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 14:27:02,387 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 14:27:02,387 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-11 14:27:02,387 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-11 14:27:02,388 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 14:27:02,388 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 14:27:02,388 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 14:27:02,389 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 14:27:02,389 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 14:27:02,389 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 14:27:02,390 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 14:27:02,391 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:02,391 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,391 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,391 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 14:27:02,392 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,392 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,392 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,392 DEBUG [Listener at localhost/44653] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_ASSIGN; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 14:27:02,392 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,392 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,392 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,392 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,392 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,392 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:02,392 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 5 msec 2023-07-11 14:27:02,393 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 14:27:02,393 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,42425,1689085468855, table=hbase:meta, region=1588230740 2023-07-11 14:27:02,394 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689085652394 2023-07-11 14:27:02,394 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 14:27:02,399 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=3300b91b6685c56113c82e496565fd11, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,399 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d300c1c4be5195cf92faac67764ebb52, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,399 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=66e7b46b2c70aaaa5ed558bcfa8ac676, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,399 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5a7a7878544668c682997c73147b1220, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,399 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5931619e05cf0cf890fb2bcad4916149, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,400 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ed162f49432e859aa69b9277091322c6, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,400 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ff6d38721d77dec2555b77bfec573075, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,400 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6a5aca3163b7bef744905773179c5d09, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,400 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ac77e8e2fc5f54d54be1f5c59a7a3d24, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,400 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=82a6a2c5d8b4f8de1fbd3bdd41150dab, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,400 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d6012602a1d2ab18cd68f81a87b29d16, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,401 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=dd06cff512fea186a79c12a85e039c36, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,401 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5b5d115c3d662e11393952c37d76b9b1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,401 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=2d05c9e5bd88a0debf2d4f4cab371c23, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,401 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=88a55364cb44dcda432e2854a92e01b4, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,401 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6ae32d4e7367668541894e8f3c21c047, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,401 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=937337250fe5f867c4822d687fa0330e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,402 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=10dfb74a1a23ab15b405d903fdf243a0, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,402 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=98b0bf96f74236d0e5d66c8a4188e4cd, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,402 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=fdb423248dfa9ba3bd628e031d476892, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,402 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ab932ae57850da80400237dc1b0b1b2f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,402 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=a731373ce9dfd79d55495dd18431f095, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,402 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=22b1c0abb82e1750694628a9ed9bc56b, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,402 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6c668c42743ec462b9ac68b0ac69bdad, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,402 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=551dbd676cfcd99c09597e9fc5285210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:02,403 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ec820b7b1bea419174597c47a0865f47, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:02,403 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=bb4185ff2e7cde2bd90fe9e4a90b7943, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,38737,1689085468814, regionLocation=jenkins-hbase9.apache.org,38737,1689085468814, openSeqNum=2 2023-07-11 14:27:02,403 INFO [Listener at localhost/44653] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 14:27:02,403 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689085682403 2023-07-11 14:27:02,403 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689085742403 2023-07-11 14:27:02,403 INFO [Listener at localhost/44653] assignment.AssignmentManager(1536): Joined the cluster in 8 msec 2023-07-11 14:27:02,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2d05c9e5bd88a0debf2d4f4cab371c23, ASSIGN}, {pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=937337250fe5f867c4822d687fa0330e, ASSIGN}, {pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6c668c42743ec462b9ac68b0ac69bdad, ASSIGN}, {pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdb423248dfa9ba3bd628e031d476892, ASSIGN}, {pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3300b91b6685c56113c82e496565fd11, ASSIGN}, {pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5931619e05cf0cf890fb2bcad4916149, ASSIGN}, {pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=82a6a2c5d8b4f8de1fbd3bdd41150dab, ASSIGN}, {pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb4185ff2e7cde2bd90fe9e4a90b7943, ASSIGN}, {pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d6012602a1d2ab18cd68f81a87b29d16, ASSIGN}, {pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5a7a7878544668c682997c73147b1220, ASSIGN}] 2023-07-11 14:27:02,405 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 14:27:02,406 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3300b91b6685c56113c82e496565fd11, ASSIGN 2023-07-11 14:27:02,407 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=73, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3300b91b6685c56113c82e496565fd11, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 14:27:02,407 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5a7a7878544668c682997c73147b1220, ASSIGN 2023-07-11 14:27:02,408 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=78, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5a7a7878544668c682997c73147b1220, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 14:27:02,409 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d6012602a1d2ab18cd68f81a87b29d16, ASSIGN 2023-07-11 14:27:02,409 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=77, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d6012602a1d2ab18cd68f81a87b29d16, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 14:27:02,410 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb4185ff2e7cde2bd90fe9e4a90b7943, ASSIGN 2023-07-11 14:27:02,411 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb4185ff2e7cde2bd90fe9e4a90b7943, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 14:27:02,411 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=82a6a2c5d8b4f8de1fbd3bdd41150dab, ASSIGN 2023-07-11 14:27:02,412 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=75, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=82a6a2c5d8b4f8de1fbd3bdd41150dab, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 14:27:02,413 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5931619e05cf0cf890fb2bcad4916149, ASSIGN 2023-07-11 14:27:02,414 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=74, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5931619e05cf0cf890fb2bcad4916149, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 14:27:02,414 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdb423248dfa9ba3bd628e031d476892, ASSIGN 2023-07-11 14:27:02,415 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdb423248dfa9ba3bd628e031d476892, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 14:27:02,416 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6c668c42743ec462b9ac68b0ac69bdad, ASSIGN 2023-07-11 14:27:02,416 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=71, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6c668c42743ec462b9ac68b0ac69bdad, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 14:27:02,417 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=937337250fe5f867c4822d687fa0330e, ASSIGN 2023-07-11 14:27:02,418 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=70, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=937337250fe5f867c4822d687fa0330e, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 14:27:02,420 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2d05c9e5bd88a0debf2d4f4cab371c23, ASSIGN 2023-07-11 14:27:02,420 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=69, ppid=62, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2d05c9e5bd88a0debf2d4f4cab371c23, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-11 14:27:02,557 DEBUG [jenkins-hbase9:33119] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-07-11 14:27:02,557 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 14:27:02,557 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 14:27:02,557 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 14:27:02,557 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 14:27:02,558 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 14:27:02,558 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=3300b91b6685c56113c82e496565fd11, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:02,558 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 14:27:02,558 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 14:27:02,558 DEBUG [jenkins-hbase9:33119] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 14:27:02,559 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689085622558"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085622558"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085622558"}]},"ts":"1689085622558"} 2023-07-11 14:27:02,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=79, ppid=73, state=RUNNABLE; OpenRegionProcedure 3300b91b6685c56113c82e496565fd11, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:27:02,569 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=bb4185ff2e7cde2bd90fe9e4a90b7943, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,569 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689085622569"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085622569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085622569"}]},"ts":"1689085622569"} 2023-07-11 14:27:02,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=76, state=RUNNABLE; OpenRegionProcedure bb4185ff2e7cde2bd90fe9e4a90b7943, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:27:02,573 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=fdb423248dfa9ba3bd628e031d476892, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,573 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085622573"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085622573"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085622573"}]},"ts":"1689085622573"} 2023-07-11 14:27:02,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=72, state=RUNNABLE; OpenRegionProcedure fdb423248dfa9ba3bd628e031d476892, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:27:02,576 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=2d05c9e5bd88a0debf2d4f4cab371c23, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,577 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085622576"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085622576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085622576"}]},"ts":"1689085622576"} 2023-07-11 14:27:02,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=69, state=RUNNABLE; OpenRegionProcedure 2d05c9e5bd88a0debf2d4f4cab371c23, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:27:02,580 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=82a6a2c5d8b4f8de1fbd3bdd41150dab, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,580 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085622580"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085622580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085622580"}]},"ts":"1689085622580"} 2023-07-11 14:27:02,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=75, state=RUNNABLE; OpenRegionProcedure 82a6a2c5d8b4f8de1fbd3bdd41150dab, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:27:02,583 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=78 updating hbase:meta row=5a7a7878544668c682997c73147b1220, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,583 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085622583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085622583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085622583"}]},"ts":"1689085622583"} 2023-07-11 14:27:02,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=78, state=RUNNABLE; OpenRegionProcedure 5a7a7878544668c682997c73147b1220, server=jenkins-hbase9.apache.org,42425,1689085468855}] 2023-07-11 14:27:02,587 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=6c668c42743ec462b9ac68b0ac69bdad, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:02,587 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085622587"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085622587"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085622587"}]},"ts":"1689085622587"} 2023-07-11 14:27:02,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=71, state=RUNNABLE; OpenRegionProcedure 6c668c42743ec462b9ac68b0ac69bdad, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:27:02,591 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=937337250fe5f867c4822d687fa0330e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:02,591 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085622591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085622591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085622591"}]},"ts":"1689085622591"} 2023-07-11 14:27:02,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=86, ppid=70, state=RUNNABLE; OpenRegionProcedure 937337250fe5f867c4822d687fa0330e, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:27:02,594 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=77 updating hbase:meta row=d6012602a1d2ab18cd68f81a87b29d16, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:02,594 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085622594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085622594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085622594"}]},"ts":"1689085622594"} 2023-07-11 14:27:02,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=77, state=RUNNABLE; OpenRegionProcedure d6012602a1d2ab18cd68f81a87b29d16, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:27:02,597 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=5931619e05cf0cf890fb2bcad4916149, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:02,597 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085622597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689085622597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689085622597"}]},"ts":"1689085622597"} 2023-07-11 14:27:02,598 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=74, state=RUNNABLE; OpenRegionProcedure 5931619e05cf0cf890fb2bcad4916149, server=jenkins-hbase9.apache.org,36555,1689085468888}] 2023-07-11 14:27:02,721 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 14:27:02,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:27:02,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fdb423248dfa9ba3bd628e031d476892, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2023-07-11 14:27:02,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:02,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:27:02,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:02,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:02,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:27:02,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 937337250fe5f867c4822d687fa0330e, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2023-07-11 14:27:02,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 937337250fe5f867c4822d687fa0330e 2023-07-11 14:27:02,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:27:02,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 937337250fe5f867c4822d687fa0330e 2023-07-11 14:27:02,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 937337250fe5f867c4822d687fa0330e 2023-07-11 14:27:02,730 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:02,732 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 937337250fe5f867c4822d687fa0330e 2023-07-11 14:27:02,732 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:27:02,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3300b91b6685c56113c82e496565fd11, NAME => 'hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11.', STARTKEY => '', ENDKEY => ''} 2023-07-11 14:27:02,733 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily11 2023-07-11 14:27:02,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3300b91b6685c56113c82e496565fd11 2023-07-11 14:27:02,733 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily11 2023-07-11 14:27:02,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:27:02,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3300b91b6685c56113c82e496565fd11 2023-07-11 14:27:02,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3300b91b6685c56113c82e496565fd11 2023-07-11 14:27:02,733 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdb423248dfa9ba3bd628e031d476892 columnFamilyName colfamily11 2023-07-11 14:27:02,733 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily11 2023-07-11 14:27:02,734 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily11 2023-07-11 14:27:02,734 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 937337250fe5f867c4822d687fa0330e columnFamilyName colfamily11 2023-07-11 14:27:02,734 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(310): Store=fdb423248dfa9ba3bd628e031d476892/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,734 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:02,735 INFO [StoreOpener-3300b91b6685c56113c82e496565fd11-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3300b91b6685c56113c82e496565fd11 2023-07-11 14:27:02,735 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(310): Store=937337250fe5f867c4822d687fa0330e/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,735 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 937337250fe5f867c4822d687fa0330e 2023-07-11 14:27:02,736 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily21 2023-07-11 14:27:02,736 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily21 2023-07-11 14:27:02,736 DEBUG [StoreOpener-3300b91b6685c56113c82e496565fd11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/info 2023-07-11 14:27:02,736 DEBUG [StoreOpener-3300b91b6685c56113c82e496565fd11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/info 2023-07-11 14:27:02,736 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdb423248dfa9ba3bd628e031d476892 columnFamilyName colfamily21 2023-07-11 14:27:02,736 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily21 2023-07-11 14:27:02,736 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily21 2023-07-11 14:27:02,737 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 937337250fe5f867c4822d687fa0330e columnFamilyName colfamily21 2023-07-11 14:27:02,737 INFO [StoreOpener-3300b91b6685c56113c82e496565fd11-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3300b91b6685c56113c82e496565fd11 columnFamilyName info 2023-07-11 14:27:02,737 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(310): Store=fdb423248dfa9ba3bd628e031d476892/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,737 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:02,737 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(310): Store=937337250fe5f867c4822d687fa0330e/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,738 INFO [StoreOpener-3300b91b6685c56113c82e496565fd11-1] regionserver.HStore(310): Store=3300b91b6685c56113c82e496565fd11/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,738 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 937337250fe5f867c4822d687fa0330e 2023-07-11 14:27:02,742 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily31 2023-07-11 14:27:02,742 DEBUG [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily31 2023-07-11 14:27:02,742 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdb423248dfa9ba3bd628e031d476892 columnFamilyName colfamily31 2023-07-11 14:27:02,743 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily31 2023-07-11 14:27:02,743 INFO [StoreOpener-fdb423248dfa9ba3bd628e031d476892-1] regionserver.HStore(310): Store=fdb423248dfa9ba3bd628e031d476892/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,743 DEBUG [StoreOpener-937337250fe5f867c4822d687fa0330e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily31 2023-07-11 14:27:02,743 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11 2023-07-11 14:27:02,743 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 937337250fe5f867c4822d687fa0330e columnFamilyName colfamily31 2023-07-11 14:27:02,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:02,745 INFO [StoreOpener-937337250fe5f867c4822d687fa0330e-1] regionserver.HStore(310): Store=937337250fe5f867c4822d687fa0330e/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e 2023-07-11 14:27:02,746 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11 2023-07-11 14:27:02,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:02,747 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/0000000000000000005 2023-07-11 14:27:02,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/0000000000000000004 2023-07-11 14:27:02,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e 2023-07-11 14:27:02,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/0000000000000000004 2023-07-11 14:27:02,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/0000000000000000004 2023-07-11 14:27:02,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing fdb423248dfa9ba3bd628e031d476892 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:02,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/0000000000000000004 2023-07-11 14:27:02,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 937337250fe5f867c4822d687fa0330e 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:02,760 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 2, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=5, path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/0000000000000000005 2023-07-11 14:27:02,761 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 3300b91b6685c56113c82e496565fd11 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 14:27:02,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/.tmp/colfamily11/f7deb9106d7c4ea1a63325d8a06cb1c9 2023-07-11 14:27:02,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/.tmp/colfamily11/2aa243b5da5d4648b7c11b1b7d4b7404 2023-07-11 14:27:02,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/.tmp/colfamily11/2aa243b5da5d4648b7c11b1b7d4b7404 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily11/2aa243b5da5d4648b7c11b1b7d4b7404 2023-07-11 14:27:02,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/colfamily11/2aa243b5da5d4648b7c11b1b7d4b7404, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 14:27:02,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/.tmp/colfamily11/f7deb9106d7c4ea1a63325d8a06cb1c9 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily11/f7deb9106d7c4ea1a63325d8a06cb1c9 2023-07-11 14:27:02,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for fdb423248dfa9ba3bd628e031d476892 in 135ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 14:27:02,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/0000000000000000004 2023-07-11 14:27:02,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:27:02,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:02,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 14:27:02,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened fdb423248dfa9ba3bd628e031d476892; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72784315, jitterRate=0.08457081019878387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:27:02,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for fdb423248dfa9ba3bd628e031d476892: 2023-07-11 14:27:02,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/colfamily11/f7deb9106d7c4ea1a63325d8a06cb1c9, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 14:27:02,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 937337250fe5f867c4822d687fa0330e in 164ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 14:27:02,924 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/.tmp/info/1e7c40ac55e64f7b923b7b0849692c11 2023-07-11 14:27:02,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/0000000000000000004 2023-07-11 14:27:02,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892., pid=81, masterSystemTime=1689085622722 2023-07-11 14:27:02,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:27:02,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:27:02,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:27:02,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d05c9e5bd88a0debf2d4f4cab371c23, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2023-07-11 14:27:02,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:27:02,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:27:02,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:27:02,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:27:02,930 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=fdb423248dfa9ba3bd628e031d476892, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:02,930 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085622930"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085622930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085622930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085622930"}]},"ts":"1689085622930"} 2023-07-11 14:27:02,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:27:02,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 937337250fe5f867c4822d687fa0330e 2023-07-11 14:27:02,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=72 2023-07-11 14:27:02,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=72, state=SUCCESS; OpenRegionProcedure fdb423248dfa9ba3bd628e031d476892, server=jenkins-hbase9.apache.org,42425,1689085468855 in 358 msec 2023-07-11 14:27:02,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdb423248dfa9ba3bd628e031d476892, ASSIGN in 531 msec 2023-07-11 14:27:02,938 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:27:02,939 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily11 2023-07-11 14:27:02,939 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily11 2023-07-11 14:27:02,940 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d05c9e5bd88a0debf2d4f4cab371c23 columnFamilyName colfamily11 2023-07-11 14:27:02,941 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(310): Store=2d05c9e5bd88a0debf2d4f4cab371c23/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,942 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:27:02,943 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily21 2023-07-11 14:27:02,943 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily21 2023-07-11 14:27:02,944 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d05c9e5bd88a0debf2d4f4cab371c23 columnFamilyName colfamily21 2023-07-11 14:27:02,944 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(310): Store=2d05c9e5bd88a0debf2d4f4cab371c23/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,944 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:27:02,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 14:27:02,952 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily31 2023-07-11 14:27:02,953 DEBUG [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily31 2023-07-11 14:27:02,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 937337250fe5f867c4822d687fa0330e; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69298609, jitterRate=0.032629743218421936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:27:02,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 937337250fe5f867c4822d687fa0330e: 2023-07-11 14:27:02,953 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d05c9e5bd88a0debf2d4f4cab371c23 columnFamilyName colfamily31 2023-07-11 14:27:02,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e., pid=86, masterSystemTime=1689085622718 2023-07-11 14:27:02,954 INFO [StoreOpener-2d05c9e5bd88a0debf2d4f4cab371c23-1] regionserver.HStore(310): Store=2d05c9e5bd88a0debf2d4f4cab371c23/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/.tmp/info/1e7c40ac55e64f7b923b7b0849692c11 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/info/1e7c40ac55e64f7b923b7b0849692c11 2023-07-11 14:27:02,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:27:02,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:27:02,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:27:02,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d6012602a1d2ab18cd68f81a87b29d16, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2023-07-11 14:27:02,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:02,957 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=937337250fe5f867c4822d687fa0330e, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:02,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:27:02,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:27:02,957 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085622957"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085622957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085622957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085622957"}]},"ts":"1689085622957"} 2023-07-11 14:27:02,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:02,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:02,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:27:02,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/0000000000000000004 2023-07-11 14:27:02,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=70 2023-07-11 14:27:02,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=70, state=SUCCESS; OpenRegionProcedure 937337250fe5f867c4822d687fa0330e, server=jenkins-hbase9.apache.org,36555,1689085468888 in 368 msec 2023-07-11 14:27:02,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=937337250fe5f867c4822d687fa0330e, ASSIGN in 559 msec 2023-07-11 14:27:02,966 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:02,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/0000000000000000004 2023-07-11 14:27:02,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 2d05c9e5bd88a0debf2d4f4cab371c23 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:02,970 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily11 2023-07-11 14:27:02,970 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily11 2023-07-11 14:27:02,970 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6012602a1d2ab18cd68f81a87b29d16 columnFamilyName colfamily11 2023-07-11 14:27:02,982 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(310): Store=d6012602a1d2ab18cd68f81a87b29d16/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,982 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:02,984 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/info/1e7c40ac55e64f7b923b7b0849692c11, entries=2, sequenceid=5, filesize=4.8 K 2023-07-11 14:27:02,984 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3300b91b6685c56113c82e496565fd11 in 224ms, sequenceid=5, compaction requested=false; wal=null 2023-07-11 14:27:02,986 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily21 2023-07-11 14:27:02,986 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily21 2023-07-11 14:27:02,986 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/0000000000000000005 2023-07-11 14:27:02,986 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6012602a1d2ab18cd68f81a87b29d16 columnFamilyName colfamily21 2023-07-11 14:27:02,987 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(310): Store=d6012602a1d2ab18cd68f81a87b29d16/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,988 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:02,990 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily31 2023-07-11 14:27:02,990 DEBUG [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily31 2023-07-11 14:27:02,990 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6012602a1d2ab18cd68f81a87b29d16 columnFamilyName colfamily31 2023-07-11 14:27:02,991 INFO [StoreOpener-d6012602a1d2ab18cd68f81a87b29d16-1] regionserver.HStore(310): Store=d6012602a1d2ab18cd68f81a87b29d16/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:02,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3300b91b6685c56113c82e496565fd11 2023-07-11 14:27:02,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:02,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:02,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/0000000000000000004 2023-07-11 14:27:03,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=1 2023-07-11 14:27:03,004 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3300b91b6685c56113c82e496565fd11; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60874420, jitterRate=-0.09290045499801636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 14:27:03,004 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3300b91b6685c56113c82e496565fd11: 2023-07-11 14:27:03,005 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11., pid=79, masterSystemTime=1689085622718 2023-07-11 14:27:03,007 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:27:03,007 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:27:03,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/0000000000000000004 2023-07-11 14:27:03,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing d6012602a1d2ab18cd68f81a87b29d16 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:03,009 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=3300b91b6685c56113c82e496565fd11, regionState=OPEN, openSeqNum=6, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:03,009 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689085623009"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085623009"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085623009"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085623009"}]},"ts":"1689085623009"} 2023-07-11 14:27:03,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=79, resume processing ppid=73 2023-07-11 14:27:03,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, ppid=73, state=SUCCESS; OpenRegionProcedure 3300b91b6685c56113c82e496565fd11, server=jenkins-hbase9.apache.org,36555,1689085468888 in 445 msec 2023-07-11 14:27:03,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3300b91b6685c56113c82e496565fd11, ASSIGN in 607 msec 2023-07-11 14:27:03,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/.tmp/colfamily11/63e5a694c0be41679be40ffccf53036e 2023-07-11 14:27:03,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/.tmp/colfamily11/63e5a694c0be41679be40ffccf53036e as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily11/63e5a694c0be41679be40ffccf53036e 2023-07-11 14:27:03,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/colfamily11/63e5a694c0be41679be40ffccf53036e, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 14:27:03,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 2d05c9e5bd88a0debf2d4f4cab371c23 in 76ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 14:27:03,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/0000000000000000004 2023-07-11 14:27:03,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:27:03,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:27:03,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 14:27:03,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2d05c9e5bd88a0debf2d4f4cab371c23; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72515761, jitterRate=0.08056904375553131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:27:03,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2d05c9e5bd88a0debf2d4f4cab371c23: 2023-07-11 14:27:03,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23., pid=82, masterSystemTime=1689085622722 2023-07-11 14:27:03,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:27:03,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:27:03,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:27:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb4185ff2e7cde2bd90fe9e4a90b7943, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943.', STARTKEY => 'zzz', ENDKEY => ''} 2023-07-11 14:27:03,068 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=2d05c9e5bd88a0debf2d4f4cab371c23, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,068 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085623068"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085623068"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085623068"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085623068"}]},"ts":"1689085623068"} 2023-07-11 14:27:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:27:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:27:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:27:03,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:27:03,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=69 2023-07-11 14:27:03,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=69, state=SUCCESS; OpenRegionProcedure 2d05c9e5bd88a0debf2d4f4cab371c23, server=jenkins-hbase9.apache.org,42425,1689085468855 in 493 msec 2023-07-11 14:27:03,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2d05c9e5bd88a0debf2d4f4cab371c23, ASSIGN in 670 msec 2023-07-11 14:27:03,086 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:27:03,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/.tmp/colfamily11/78bbee64ed68406dba90eae2ea6c7813 2023-07-11 14:27:03,095 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily11 2023-07-11 14:27:03,095 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily11 2023-07-11 14:27:03,095 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4185ff2e7cde2bd90fe9e4a90b7943 columnFamilyName colfamily11 2023-07-11 14:27:03,096 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(310): Store=bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,096 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:27:03,098 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily21 2023-07-11 14:27:03,098 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily21 2023-07-11 14:27:03,098 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4185ff2e7cde2bd90fe9e4a90b7943 columnFamilyName colfamily21 2023-07-11 14:27:03,102 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(310): Store=bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/.tmp/colfamily11/78bbee64ed68406dba90eae2ea6c7813 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily11/78bbee64ed68406dba90eae2ea6c7813 2023-07-11 14:27:03,102 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:27:03,104 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily31 2023-07-11 14:27:03,104 DEBUG [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily31 2023-07-11 14:27:03,104 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4185ff2e7cde2bd90fe9e4a90b7943 columnFamilyName colfamily31 2023-07-11 14:27:03,108 INFO [StoreOpener-bb4185ff2e7cde2bd90fe9e4a90b7943-1] regionserver.HStore(310): Store=bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:27:03,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:27:03,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/0000000000000000004 2023-07-11 14:27:03,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 1, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/0000000000000000004 2023-07-11 14:27:03,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing bb4185ff2e7cde2bd90fe9e4a90b7943 3/3 column families, dataSize=48 B heapSize=888 B 2023-07-11 14:27:03,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/colfamily11/78bbee64ed68406dba90eae2ea6c7813, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 14:27:03,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for d6012602a1d2ab18cd68f81a87b29d16 in 112ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 14:27:03,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/0000000000000000004 2023-07-11 14:27:03,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:27:03,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:03,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 14:27:03,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d6012602a1d2ab18cd68f81a87b29d16; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67839304, jitterRate=0.010884404182434082}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:27:03,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d6012602a1d2ab18cd68f81a87b29d16: 2023-07-11 14:27:03,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16., pid=87, masterSystemTime=1689085622718 2023-07-11 14:27:03,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:27:03,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:27:03,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:27:03,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5931619e05cf0cf890fb2bcad4916149, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2023-07-11 14:27:03,164 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=77 updating hbase:meta row=d6012602a1d2ab18cd68f81a87b29d16, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:03,164 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085623163"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085623163"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085623163"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085623163"}]},"ts":"1689085623163"} 2023-07-11 14:27:03,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:27:03,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:27:03,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:27:03,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:27:03,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=77 2023-07-11 14:27:03,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=77, state=SUCCESS; OpenRegionProcedure d6012602a1d2ab18cd68f81a87b29d16, server=jenkins-hbase9.apache.org,36555,1689085468888 in 571 msec 2023-07-11 14:27:03,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d6012602a1d2ab18cd68f81a87b29d16, ASSIGN in 764 msec 2023-07-11 14:27:03,178 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:27:03,182 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily11 2023-07-11 14:27:03,183 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily11 2023-07-11 14:27:03,183 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5931619e05cf0cf890fb2bcad4916149 columnFamilyName colfamily11 2023-07-11 14:27:03,186 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(310): Store=5931619e05cf0cf890fb2bcad4916149/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,186 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:27:03,188 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily21 2023-07-11 14:27:03,188 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily21 2023-07-11 14:27:03,188 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5931619e05cf0cf890fb2bcad4916149 columnFamilyName colfamily21 2023-07-11 14:27:03,189 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(310): Store=5931619e05cf0cf890fb2bcad4916149/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,189 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:27:03,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48 B at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/.tmp/colfamily11/8f214e5e109c4e3abbfb0666e1e812a1 2023-07-11 14:27:03,191 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily31 2023-07-11 14:27:03,191 DEBUG [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily31 2023-07-11 14:27:03,191 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5931619e05cf0cf890fb2bcad4916149 columnFamilyName colfamily31 2023-07-11 14:27:03,192 INFO [StoreOpener-5931619e05cf0cf890fb2bcad4916149-1] regionserver.HStore(310): Store=5931619e05cf0cf890fb2bcad4916149/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:27:03,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:27:03,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/0000000000000000004 2023-07-11 14:27:03,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/.tmp/colfamily11/8f214e5e109c4e3abbfb0666e1e812a1 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily11/8f214e5e109c4e3abbfb0666e1e812a1 2023-07-11 14:27:03,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/0000000000000000004 2023-07-11 14:27:03,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 5931619e05cf0cf890fb2bcad4916149 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:03,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/colfamily11/8f214e5e109c4e3abbfb0666e1e812a1, entries=1, sequenceid=4, filesize=4.6 K 2023-07-11 14:27:03,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for bb4185ff2e7cde2bd90fe9e4a90b7943 in 100ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 14:27:03,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/0000000000000000004 2023-07-11 14:27:03,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:27:03,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:27:03,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 14:27:03,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened bb4185ff2e7cde2bd90fe9e4a90b7943; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70818948, jitterRate=0.05528455972671509}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:27:03,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for bb4185ff2e7cde2bd90fe9e4a90b7943: 2023-07-11 14:27:03,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943., pid=80, masterSystemTime=1689085622722 2023-07-11 14:27:03,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:27:03,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:27:03,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:27:03,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a7a7878544668c682997c73147b1220, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2023-07-11 14:27:03,257 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=bb4185ff2e7cde2bd90fe9e4a90b7943, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,257 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943.","families":{"info":[{"qualifier":"regioninfo","vlen":106,"tag":[],"timestamp":"1689085623257"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085623257"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085623257"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085623257"}]},"ts":"1689085623257"} 2023-07-11 14:27:03,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 5a7a7878544668c682997c73147b1220 2023-07-11 14:27:03,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:27:03,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5a7a7878544668c682997c73147b1220 2023-07-11 14:27:03,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5a7a7878544668c682997c73147b1220 2023-07-11 14:27:03,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/.tmp/colfamily11/1c68faf3cc604dea9895e08718ea5a55 2023-07-11 14:27:03,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=76 2023-07-11 14:27:03,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=76, state=SUCCESS; OpenRegionProcedure bb4185ff2e7cde2bd90fe9e4a90b7943, server=jenkins-hbase9.apache.org,42425,1689085468855 in 689 msec 2023-07-11 14:27:03,264 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 5a7a7878544668c682997c73147b1220 2023-07-11 14:27:03,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb4185ff2e7cde2bd90fe9e4a90b7943, ASSIGN in 858 msec 2023-07-11 14:27:03,266 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily11 2023-07-11 14:27:03,266 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily11 2023-07-11 14:27:03,266 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a7a7878544668c682997c73147b1220 columnFamilyName colfamily11 2023-07-11 14:27:03,267 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(310): Store=5a7a7878544668c682997c73147b1220/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,267 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 5a7a7878544668c682997c73147b1220 2023-07-11 14:27:03,268 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily21 2023-07-11 14:27:03,268 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily21 2023-07-11 14:27:03,269 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a7a7878544668c682997c73147b1220 columnFamilyName colfamily21 2023-07-11 14:27:03,272 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(310): Store=5a7a7878544668c682997c73147b1220/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,272 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 5a7a7878544668c682997c73147b1220 2023-07-11 14:27:03,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/.tmp/colfamily11/1c68faf3cc604dea9895e08718ea5a55 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily11/1c68faf3cc604dea9895e08718ea5a55 2023-07-11 14:27:03,274 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily31 2023-07-11 14:27:03,274 DEBUG [StoreOpener-5a7a7878544668c682997c73147b1220-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily31 2023-07-11 14:27:03,275 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a7a7878544668c682997c73147b1220 columnFamilyName colfamily31 2023-07-11 14:27:03,276 INFO [StoreOpener-5a7a7878544668c682997c73147b1220-1] regionserver.HStore(310): Store=5a7a7878544668c682997c73147b1220/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220 2023-07-11 14:27:03,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220 2023-07-11 14:27:03,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/0000000000000000004 2023-07-11 14:27:03,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/colfamily11/1c68faf3cc604dea9895e08718ea5a55, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 14:27:03,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 5931619e05cf0cf890fb2bcad4916149 in 73ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 14:27:03,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/0000000000000000004 2023-07-11 14:27:03,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:27:03,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:27:03,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/0000000000000000004 2023-07-11 14:27:03,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 5a7a7878544668c682997c73147b1220 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:03,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 14:27:03,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5931619e05cf0cf890fb2bcad4916149; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75255096, jitterRate=0.12138831615447998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:27:03,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5931619e05cf0cf890fb2bcad4916149: 2023-07-11 14:27:03,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149., pid=88, masterSystemTime=1689085622718 2023-07-11 14:27:03,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:27:03,317 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=5931619e05cf0cf890fb2bcad4916149, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:03,317 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085623316"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085623316"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085623316"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085623316"}]},"ts":"1689085623316"} 2023-07-11 14:27:03,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:27:03,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:27:03,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c668c42743ec462b9ac68b0ac69bdad, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad.', STARTKEY => 'www', ENDKEY => 'xxx'} 2023-07-11 14:27:03,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:27:03,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:27:03,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:27:03,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:27:03,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=74 2023-07-11 14:27:03,322 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:27:03,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=74, state=SUCCESS; OpenRegionProcedure 5931619e05cf0cf890fb2bcad4916149, server=jenkins-hbase9.apache.org,36555,1689085468888 in 721 msec 2023-07-11 14:27:03,324 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily11 2023-07-11 14:27:03,324 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily11 2023-07-11 14:27:03,324 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5931619e05cf0cf890fb2bcad4916149, ASSIGN in 917 msec 2023-07-11 14:27:03,324 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c668c42743ec462b9ac68b0ac69bdad columnFamilyName colfamily11 2023-07-11 14:27:03,326 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(310): Store=6c668c42743ec462b9ac68b0ac69bdad/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,326 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:27:03,327 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily21 2023-07-11 14:27:03,327 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily21 2023-07-11 14:27:03,328 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c668c42743ec462b9ac68b0ac69bdad columnFamilyName colfamily21 2023-07-11 14:27:03,329 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(310): Store=6c668c42743ec462b9ac68b0ac69bdad/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,329 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:27:03,331 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily31 2023-07-11 14:27:03,331 DEBUG [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily31 2023-07-11 14:27:03,332 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c668c42743ec462b9ac68b0ac69bdad columnFamilyName colfamily31 2023-07-11 14:27:03,336 INFO [StoreOpener-6c668c42743ec462b9ac68b0ac69bdad-1] regionserver.HStore(310): Store=6c668c42743ec462b9ac68b0ac69bdad/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:27:03,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:27:03,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/0000000000000000004 2023-07-11 14:27:03,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/0000000000000000004 2023-07-11 14:27:03,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 6c668c42743ec462b9ac68b0ac69bdad 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:03,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/.tmp/colfamily11/03b23730835c40948597be5751581951 2023-07-11 14:27:03,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/.tmp/colfamily11/03b23730835c40948597be5751581951 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily11/03b23730835c40948597be5751581951 2023-07-11 14:27:03,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/colfamily11/03b23730835c40948597be5751581951, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 14:27:03,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 5a7a7878544668c682997c73147b1220 in 95ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 14:27:03,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/0000000000000000004 2023-07-11 14:27:03,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:27:03,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5a7a7878544668c682997c73147b1220 2023-07-11 14:27:03,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 14:27:03,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5a7a7878544668c682997c73147b1220; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68504197, jitterRate=0.020792081952095032}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:27:03,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5a7a7878544668c682997c73147b1220: 2023-07-11 14:27:03,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220., pid=84, masterSystemTime=1689085622722 2023-07-11 14:27:03,407 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=78 updating hbase:meta row=5a7a7878544668c682997c73147b1220, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,408 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085623407"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085623407"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085623407"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085623407"}]},"ts":"1689085623407"} 2023-07-11 14:27:03,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:27:03,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:27:03,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:27:03,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82a6a2c5d8b4f8de1fbd3bdd41150dab, NAME => 'testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2023-07-11 14:27:03,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:27:03,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 14:27:03,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:27:03,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:27:03,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=78 2023-07-11 14:27:03,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=78, state=SUCCESS; OpenRegionProcedure 5a7a7878544668c682997c73147b1220, server=jenkins-hbase9.apache.org,42425,1689085468855 in 824 msec 2023-07-11 14:27:03,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5a7a7878544668c682997c73147b1220, ASSIGN in 1.0060 sec 2023-07-11 14:27:03,418 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:27:03,420 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily11 2023-07-11 14:27:03,420 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily11 2023-07-11 14:27:03,420 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82a6a2c5d8b4f8de1fbd3bdd41150dab columnFamilyName colfamily11 2023-07-11 14:27:03,422 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(310): Store=82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,422 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:27:03,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/.tmp/colfamily11/7ca44a590394410c907cce3daa34d9c9 2023-07-11 14:27:03,423 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily21 2023-07-11 14:27:03,423 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily21 2023-07-11 14:27:03,424 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82a6a2c5d8b4f8de1fbd3bdd41150dab columnFamilyName colfamily21 2023-07-11 14:27:03,424 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(310): Store=82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,424 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:27:03,426 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily31 2023-07-11 14:27:03,426 DEBUG [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily31 2023-07-11 14:27:03,426 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82a6a2c5d8b4f8de1fbd3bdd41150dab columnFamilyName colfamily31 2023-07-11 14:27:03,427 INFO [StoreOpener-82a6a2c5d8b4f8de1fbd3bdd41150dab-1] regionserver.HStore(310): Store=82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 14:27:03,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:27:03,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/.tmp/colfamily11/7ca44a590394410c907cce3daa34d9c9 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily11/7ca44a590394410c907cce3daa34d9c9 2023-07-11 14:27:03,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:27:03,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/0000000000000000004 2023-07-11 14:27:03,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 703, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=4, path=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/0000000000000000004 2023-07-11 14:27:03,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 82a6a2c5d8b4f8de1fbd3bdd41150dab 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:03,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/colfamily11/7ca44a590394410c907cce3daa34d9c9, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 14:27:03,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 6c668c42743ec462b9ac68b0ac69bdad in 92ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 14:27:03,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/0000000000000000004 2023-07-11 14:27:03,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:27:03,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:27:03,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 14:27:03,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 6c668c42743ec462b9ac68b0ac69bdad; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74989555, jitterRate=0.11743144690990448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:27:03,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 6c668c42743ec462b9ac68b0ac69bdad: 2023-07-11 14:27:03,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad., pid=85, masterSystemTime=1689085622718 2023-07-11 14:27:03,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:27:03,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/.tmp/colfamily11/f90750f9365849339996bce3b609c265 2023-07-11 14:27:03,463 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=6c668c42743ec462b9ac68b0ac69bdad, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:03,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:27:03,463 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085623463"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085623463"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085623463"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085623463"}]},"ts":"1689085623463"} 2023-07-11 14:27:03,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=71 2023-07-11 14:27:03,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=71, state=SUCCESS; OpenRegionProcedure 6c668c42743ec462b9ac68b0ac69bdad, server=jenkins-hbase9.apache.org,36555,1689085468888 in 877 msec 2023-07-11 14:27:03,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/.tmp/colfamily11/f90750f9365849339996bce3b609c265 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily11/f90750f9365849339996bce3b609c265 2023-07-11 14:27:03,478 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6c668c42743ec462b9ac68b0ac69bdad, ASSIGN in 1.0700 sec 2023-07-11 14:27:03,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/colfamily11/f90750f9365849339996bce3b609c265, entries=703, sequenceid=4, filesize=38.2 K 2023-07-11 14:27:03,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 82a6a2c5d8b4f8de1fbd3bdd41150dab in 48ms, sequenceid=4, compaction requested=false; wal=null 2023-07-11 14:27:03,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/0000000000000000004 2023-07-11 14:27:03,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 14:27:03,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:27:03,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 14:27:03,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 82a6a2c5d8b4f8de1fbd3bdd41150dab; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64858233, jitterRate=-0.033537015318870544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 14:27:03,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 82a6a2c5d8b4f8de1fbd3bdd41150dab: 2023-07-11 14:27:03,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab., pid=83, masterSystemTime=1689085622722 2023-07-11 14:27:03,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:27:03,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:27:03,497 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=82a6a2c5d8b4f8de1fbd3bdd41150dab, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,498 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab.","families":{"info":[{"qualifier":"regioninfo","vlen":109,"tag":[],"timestamp":"1689085623497"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689085623497"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689085623497"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689085623497"}]},"ts":"1689085623497"} 2023-07-11 14:27:03,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=75 2023-07-11 14:27:03,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=75, state=SUCCESS; OpenRegionProcedure 82a6a2c5d8b4f8de1fbd3bdd41150dab, server=jenkins-hbase9.apache.org,42425,1689085468855 in 918 msec 2023-07-11 14:27:03,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=62 2023-07-11 14:27:03,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=82a6a2c5d8b4f8de1fbd3bdd41150dab, ASSIGN in 1.0970 sec 2023-07-11 14:27:03,504 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase9.apache.org,38737,1689085468814 after splitting done 2023-07-11 14:27:03,504 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase9.apache.org,38737,1689085468814 from processing; numProcessing=0 2023-07-11 14:27:03,504 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: false 2023-07-11 14:27:03,504 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1759): TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:03,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 14:27:03,504 WARN [PEWorker-1] procedure2.ProcedureExecutor$WorkerThread(1980): Worker terminating UNNATURALLY null java.lang.RuntimeException: TESTING: Kill BEFORE store update: pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.kill(ProcedureExecutor.java:1761) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1703) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 14:27:03,654 INFO [Listener at localhost/44653] procedure.MasterProcedureTestingUtility(454): Restart 8 exec state=pid=62, state=SUCCESS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:03,654 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(118): RESTART - Stop 2023-07-11 14:27:03,654 INFO [Listener at localhost/44653] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 14:27:03,654 INFO [Listener at localhost/44653] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 14:27:03,654 ERROR [Listener at localhost/44653] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 14:27:03,655 INFO [Listener at localhost/44653] procedure2.ProcedureTestingUtility(130): RESTART - Start 2023-07-11 14:27:03,655 INFO [Listener at localhost/44653] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=1 2023-07-11 14:27:03,655 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(562): Starting 1 core workers (bigger of cpus/4 or 16) with max (burst) worker count=10 2023-07-11 14:27:03,655 INFO [Listener at localhost/44653] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 14:27:03,656 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 14:27:03,658 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=62, ppid=-1, class=org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure) stack ids=[0, 1, 7, 8, 14, 15, 16, 17, 18, 24, 25, 26, 27] 2023-07-11 14:27:03,658 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=65, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[9, 10, 13] 2023-07-11 14:27:03,658 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=66, ppid=65, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[11, 12] 2023-07-11 14:27:03,658 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=67, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[19, 20, 23] 2023-07-11 14:27:03,658 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=68, ppid=67, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[21, 22] 2023-07-11 14:27:03,658 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=69, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[37, 44, 65] 2023-07-11 14:27:03,658 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=82, ppid=69, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[45, 64] 2023-07-11 14:27:03,658 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=70, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[36, 52, 61] 2023-07-11 14:27:03,658 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=86, ppid=70, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[53, 60] 2023-07-11 14:27:03,659 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=71, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[35, 50, 75] 2023-07-11 14:27:03,659 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=85, ppid=71, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[51, 74] 2023-07-11 14:27:03,659 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=72, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[34, 42, 59] 2023-07-11 14:27:03,659 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=81, ppid=72, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[43, 58] 2023-07-11 14:27:03,659 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=73, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[28, 38, 63] 2023-07-11 14:27:03,659 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=79, ppid=73, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[39, 62] 2023-07-11 14:27:03,659 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=74, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[33, 56, 71] 2023-07-11 14:27:03,659 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=88, ppid=74, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[57, 70] 2023-07-11 14:27:03,659 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=75, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[32, 46, 77] 2023-07-11 14:27:03,659 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=83, ppid=75, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[47, 76] 2023-07-11 14:27:03,660 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=76, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[31, 40, 69] 2023-07-11 14:27:03,660 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=80, ppid=76, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[41, 68] 2023-07-11 14:27:03,660 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=77, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[30, 54, 67] 2023-07-11 14:27:03,660 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=87, ppid=77, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[55, 66] 2023-07-11 14:27:03,660 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=78, ppid=62, class=org.apache.hadoop.hbase.master.assignment.TransitRegionStateProcedure) stack ids=[29, 48, 73] 2023-07-11 14:27:03,660 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=84, ppid=78, class=org.apache.hadoop.hbase.master.assignment.OpenRegionProcedure) stack ids=[49, 72] 2023-07-11 14:27:03,660 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=63, ppid=62, class=org.apache.hadoop.hbase.master.procedure.SplitWALProcedure) stack ids=[2, 3, 6] 2023-07-11 14:27:03,660 DEBUG [Listener at localhost/44653] store.ProcedureTree(114): Procedure Procedure(pid=64, ppid=63, class=org.apache.hadoop.hbase.master.procedure.SplitWALRemoteProcedure) stack ids=[4, 5] 2023-07-11 14:27:03,660 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 14:27:03,661 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 14:27:03,661 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 14:27:03,661 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 14:27:03,662 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true 2023-07-11 14:27:03,665 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true 2023-07-11 14:27:03,665 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,665 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,665 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 14:27:03,665 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,665 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,665 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2d05c9e5bd88a0debf2d4f4cab371c23, ASSIGN 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=937337250fe5f867c4822d687fa0330e, ASSIGN 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6c668c42743ec462b9ac68b0ac69bdad, ASSIGN 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdb423248dfa9ba3bd628e031d476892, ASSIGN 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3300b91b6685c56113c82e496565fd11, ASSIGN 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5931619e05cf0cf890fb2bcad4916149, ASSIGN 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=82a6a2c5d8b4f8de1fbd3bdd41150dab, ASSIGN 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb4185ff2e7cde2bd90fe9e4a90b7943, ASSIGN 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d6012602a1d2ab18cd68f81a87b29d16, ASSIGN 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=78, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5a7a7878544668c682997c73147b1220, ASSIGN 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=79, ppid=73, state=SUCCESS; OpenRegionProcedure 3300b91b6685c56113c82e496565fd11, server=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=80, ppid=76, state=SUCCESS; OpenRegionProcedure bb4185ff2e7cde2bd90fe9e4a90b7943, server=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=81, ppid=72, state=SUCCESS; OpenRegionProcedure fdb423248dfa9ba3bd628e031d476892, server=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,666 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=82, ppid=69, state=SUCCESS; OpenRegionProcedure 2d05c9e5bd88a0debf2d4f4cab371c23, server=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,668 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=83, ppid=75, state=SUCCESS; OpenRegionProcedure 82a6a2c5d8b4f8de1fbd3bdd41150dab, server=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,668 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=84, ppid=78, state=SUCCESS; OpenRegionProcedure 5a7a7878544668c682997c73147b1220, server=jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:03,669 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=85, ppid=71, state=SUCCESS; OpenRegionProcedure 6c668c42743ec462b9ac68b0ac69bdad, server=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:03,669 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=86, ppid=70, state=SUCCESS; OpenRegionProcedure 937337250fe5f867c4822d687fa0330e, server=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:03,669 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=87, ppid=77, state=SUCCESS; OpenRegionProcedure d6012602a1d2ab18cd68f81a87b29d16, server=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:03,669 DEBUG [Listener at localhost/44653] procedure2.ProcedureExecutor(468): Loading pid=88, ppid=74, state=SUCCESS; OpenRegionProcedure 5931619e05cf0cf890fb2bcad4916149, server=jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:03,669 DEBUG [Listener at localhost/44653] procedure2.Procedure(966): pid=62, state=RUNNABLE:SERVER_CRASH_FINISH; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true held the lock before restarting, call acquireLock to restore it. 2023-07-11 14:27:03,669 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=63, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,669 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=64, ppid=63, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.meta.1689085470528.meta, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,669 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=65, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=66, ppid=65, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=67, ppid=62, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=68, ppid=67, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C38737%2C1689085468814.1689085470282, worker=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=69, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=2d05c9e5bd88a0debf2d4f4cab371c23, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=70, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=937337250fe5f867c4822d687fa0330e, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=71, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=6c668c42743ec462b9ac68b0ac69bdad, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=72, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=fdb423248dfa9ba3bd628e031d476892, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=73, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3300b91b6685c56113c82e496565fd11, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=74, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5931619e05cf0cf890fb2bcad4916149, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=75, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=82a6a2c5d8b4f8de1fbd3bdd41150dab, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=76, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=bb4185ff2e7cde2bd90fe9e4a90b7943, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,670 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=77, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=d6012602a1d2ab18cd68f81a87b29d16, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,671 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=78, ppid=62, state=SUCCESS; TransitRegionStateProcedure table=testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true, region=5a7a7878544668c682997c73147b1220, ASSIGN didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,671 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=79, ppid=73, state=SUCCESS; OpenRegionProcedure 3300b91b6685c56113c82e496565fd11, server=jenkins-hbase9.apache.org,36555,1689085468888 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,671 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=80, ppid=76, state=SUCCESS; OpenRegionProcedure bb4185ff2e7cde2bd90fe9e4a90b7943, server=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,671 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=81, ppid=72, state=SUCCESS; OpenRegionProcedure fdb423248dfa9ba3bd628e031d476892, server=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,671 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=82, ppid=69, state=SUCCESS; OpenRegionProcedure 2d05c9e5bd88a0debf2d4f4cab371c23, server=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,671 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=83, ppid=75, state=SUCCESS; OpenRegionProcedure 82a6a2c5d8b4f8de1fbd3bdd41150dab, server=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,671 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=84, ppid=78, state=SUCCESS; OpenRegionProcedure 5a7a7878544668c682997c73147b1220, server=jenkins-hbase9.apache.org,42425,1689085468855 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,671 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=85, ppid=71, state=SUCCESS; OpenRegionProcedure 6c668c42743ec462b9ac68b0ac69bdad, server=jenkins-hbase9.apache.org,36555,1689085468888 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,671 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=86, ppid=70, state=SUCCESS; OpenRegionProcedure 937337250fe5f867c4822d687fa0330e, server=jenkins-hbase9.apache.org,36555,1689085468888 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,671 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=87, ppid=77, state=SUCCESS; OpenRegionProcedure d6012602a1d2ab18cd68f81a87b29d16, server=jenkins-hbase9.apache.org,36555,1689085468888 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,671 DEBUG [Listener at localhost/44653] procedure2.Procedure(946): pid=88, ppid=74, state=SUCCESS; OpenRegionProcedure 5931619e05cf0cf890fb2bcad4916149, server=jenkins-hbase9.apache.org,36555,1689085468888 didn't hold the lock before restarting, skip acquiring lock. 2023-07-11 14:27:03,672 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 15 msec 2023-07-11 14:27:03,678 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 14:27:03,680 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,42425,1689085468855, table=hbase:meta, region=1588230740 2023-07-11 14:27:03,689 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689085653689 2023-07-11 14:27:03,690 DEBUG [Listener at localhost/44653] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 14:27:03,695 DEBUG [PEWorker-1] master.DeadServer(103): Processing jenkins-hbase9.apache.org,38737,1689085468814; numProcessing=1 2023-07-11 14:27:03,703 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=3300b91b6685c56113c82e496565fd11, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=6 2023-07-11 14:27:03,703 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d300c1c4be5195cf92faac67764ebb52, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:03,703 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=66e7b46b2c70aaaa5ed558bcfa8ac676, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:03,704 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5a7a7878544668c682997c73147b1220, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=5 2023-07-11 14:27:03,704 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5931619e05cf0cf890fb2bcad4916149, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=5 2023-07-11 14:27:03,704 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ed162f49432e859aa69b9277091322c6, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:03,704 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ff6d38721d77dec2555b77bfec573075, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:03,704 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6a5aca3163b7bef744905773179c5d09, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:03,705 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ac77e8e2fc5f54d54be1f5c59a7a3d24, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:03,705 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=82a6a2c5d8b4f8de1fbd3bdd41150dab, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=5 2023-07-11 14:27:03,705 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=d6012602a1d2ab18cd68f81a87b29d16, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=5 2023-07-11 14:27:03,705 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=dd06cff512fea186a79c12a85e039c36, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:03,705 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=5b5d115c3d662e11393952c37d76b9b1, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:03,706 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=2d05c9e5bd88a0debf2d4f4cab371c23, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=5 2023-07-11 14:27:03,706 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=88a55364cb44dcda432e2854a92e01b4, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:03,706 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6ae32d4e7367668541894e8f3c21c047, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:03,706 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=937337250fe5f867c4822d687fa0330e, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=5 2023-07-11 14:27:03,706 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=10dfb74a1a23ab15b405d903fdf243a0, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:03,706 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=98b0bf96f74236d0e5d66c8a4188e4cd, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:03,707 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=fdb423248dfa9ba3bd628e031d476892, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=5 2023-07-11 14:27:03,707 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ab932ae57850da80400237dc1b0b1b2f, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:03,707 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=a731373ce9dfd79d55495dd18431f095, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:03,707 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=22b1c0abb82e1750694628a9ed9bc56b, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:03,707 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=6c668c42743ec462b9ac68b0ac69bdad, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=5 2023-07-11 14:27:03,708 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=551dbd676cfcd99c09597e9fc5285210, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,36555,1689085468888, regionLocation=jenkins-hbase9.apache.org,36555,1689085468888, openSeqNum=2 2023-07-11 14:27:03,708 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=ec820b7b1bea419174597c47a0865f47, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=2 2023-07-11 14:27:03,708 DEBUG [Listener at localhost/44653] assignment.RegionStateStore(147): Load hbase:meta entry region=bb4185ff2e7cde2bd90fe9e4a90b7943, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,42425,1689085468855, regionLocation=jenkins-hbase9.apache.org,42425,1689085468855, openSeqNum=5 2023-07-11 14:27:03,708 INFO [Listener at localhost/44653] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-11 14:27:03,708 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689085683708 2023-07-11 14:27:03,708 INFO [Listener at localhost/44653] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689085743708 2023-07-11 14:27:03,708 INFO [Listener at localhost/44653] assignment.AssignmentManager(1536): Joined the cluster in 18 msec 2023-07-11 14:27:03,714 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase9.apache.org,38737,1689085468814 after splitting done 2023-07-11 14:27:03,714 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase9.apache.org,38737,1689085468814 from processing; numProcessing=0 2023-07-11 14:27:03,714 WARN [PEWorker-1] procedure2.ProcedureExecutor$Testing(122): Toggle KILL before store update to: true 2023-07-11 14:27:03,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; ServerCrashProcedure jenkins-hbase9.apache.org,38737,1689085468814, splitWal=true, meta=true in 2 mins, 28.996 sec 2023-07-11 14:27:03,963 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 14:27:03,975 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:27:03,978 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 14:27:03,979 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 14:27:03,982 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 14:27:03,985 WARN [RPCClient-NioEventLoopGroup-6-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:38737 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:716) at org.apache.hbase.thirdparty.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 14:27:03,988 DEBUG [RPCClient-NioEventLoopGroup-6-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:38737 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:38737 2023-07-11 14:27:04,089 DEBUG [hconnection-0x8db6223-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:27:04,210 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 14:27:04,211 DEBUG [hconnection-0x8db6223-shared-pool-9] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:27:04,327 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 14:27:04,332 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 14:27:04,336 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 14:27:04,339 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 14:27:04,343 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 14:27:04,343 DEBUG [hconnection-0x8db6223-shared-pool-8] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:27:04,458 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 14:27:04,458 DEBUG [hconnection-0x8db6223-shared-pool-9] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:27:04,572 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 14:27:04,575 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 14:27:04,579 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 14:27:04,580 DEBUG [hconnection-0x8db6223-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:27:04,689 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 14:27:04,691 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 14:27:04,694 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 14:27:04,694 DEBUG [hconnection-0x8db6223-shared-pool-9] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:27:04,803 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 14:27:04,805 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 14:27:04,807 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 14:27:04,807 DEBUG [hconnection-0x8db6223-shared-pool-6] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:27:04,917 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 14:27:04,920 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 14:27:04,923 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 14:27:04,925 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 14:27:04,925 DEBUG [hconnection-0x8db6223-shared-pool-10] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:27:05,037 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 14:27:05,041 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 14:27:05,045 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 14:27:05,045 DEBUG [hconnection-0x8db6223-shared-pool-7] ipc.AbstractRpcClient(347): Not trying to connect to jenkins-hbase9.apache.org/172.31.2.10:38737 this server is in the failed servers list 2023-07-11 14:27:05,157 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'bbb', inclusive 2023-07-11 14:27:05,159 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ccc', inclusive 2023-07-11 14:27:05,161 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ddd', inclusive 2023-07-11 14:27:05,163 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'eee', inclusive 2023-07-11 14:27:05,166 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'fff', inclusive 2023-07-11 14:27:05,168 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ggg', inclusive 2023-07-11 14:27:05,170 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'hhh', inclusive 2023-07-11 14:27:05,172 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'iii', inclusive 2023-07-11 14:27:05,175 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'jjj', inclusive 2023-07-11 14:27:05,177 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'kkk', inclusive 2023-07-11 14:27:05,178 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'lll', inclusive 2023-07-11 14:27:05,181 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'mmm', inclusive 2023-07-11 14:27:05,183 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'nnn', inclusive 2023-07-11 14:27:05,185 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ooo', inclusive 2023-07-11 14:27:05,188 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ppp', inclusive 2023-07-11 14:27:05,190 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'qqq', inclusive 2023-07-11 14:27:05,192 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'rrr', inclusive 2023-07-11 14:27:05,194 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'sss', inclusive 2023-07-11 14:27:05,197 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'ttt', inclusive 2023-07-11 14:27:05,199 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'uuu', inclusive 2023-07-11 14:27:05,201 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'vvv', inclusive 2023-07-11 14:27:05,203 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'www', inclusive 2023-07-11 14:27:05,205 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'xxx', inclusive 2023-07-11 14:27:05,207 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'yyy', inclusive 2023-07-11 14:27:05,209 DEBUG [Listener at localhost/44653] client.ClientScanner(240): Advancing internal scanner to startKey at 'zzz', inclusive 2023-07-11 14:27:05,215 WARN [Listener at localhost/44653] procedure2.ProcedureTestingUtility(193): Set Kill before store update to: false 2023-07-11 14:27:05,215 INFO [Listener at localhost/44653] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 14:27:05,215 INFO [Listener at localhost/44653] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 14:27:05,216 DEBUG [Listener at localhost/44653] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5daa0c55 to 127.0.0.1:54666 2023-07-11 14:27:05,216 DEBUG [Listener at localhost/44653] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:27:05,218 DEBUG [Listener at localhost/44653] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 14:27:05,218 DEBUG [Listener at localhost/44653] util.JVMClusterUtil(257): Found active master hash=1020157292, stopped=false 2023-07-11 14:27:05,218 INFO [Listener at localhost/44653] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,33119,1689085467657 2023-07-11 14:27:05,221 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 14:27:05,221 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 14:27:05,221 INFO [Listener at localhost/44653] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 14:27:05,221 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:27:05,224 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 14:27:05,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 14:27:05,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 14:27:05,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 14:27:05,224 DEBUG [Listener at localhost/44653] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c8b3845 to 127.0.0.1:54666 2023-07-11 14:27:05,225 DEBUG [Listener at localhost/44653] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:27:05,232 INFO [Listener at localhost/44653] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,42425,1689085468855' ***** 2023-07-11 14:27:05,233 INFO [Listener at localhost/44653] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 14:27:05,233 INFO [Listener at localhost/44653] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,36555,1689085468888' ***** 2023-07-11 14:27:05,233 INFO [Listener at localhost/44653] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 14:27:05,233 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 14:27:05,233 INFO [RS:1;jenkins-hbase9:42425] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 14:27:05,233 INFO [RS:2;jenkins-hbase9:36555] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 14:27:05,234 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 14:27:05,234 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 14:27:05,234 INFO [RS:1;jenkins-hbase9:42425] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 14:27:05,234 INFO [RS:2;jenkins-hbase9:36555] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 14:27:05,234 INFO [RS:1;jenkins-hbase9:42425] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 14:27:05,235 INFO [RS:2;jenkins-hbase9:36555] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 14:27:05,235 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for 10dfb74a1a23ab15b405d903fdf243a0 2023-07-11 14:27:05,235 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for dd06cff512fea186a79c12a85e039c36 2023-07-11 14:27:05,235 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 14:27:05,236 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for ec820b7b1bea419174597c47a0865f47 2023-07-11 14:27:05,236 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for bb4185ff2e7cde2bd90fe9e4a90b7943 2023-07-11 14:27:05,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 10dfb74a1a23ab15b405d903fdf243a0, disabling compactions & flushes 2023-07-11 14:27:05,237 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for 88a55364cb44dcda432e2854a92e01b4 2023-07-11 14:27:05,237 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for 5b5d115c3d662e11393952c37d76b9b1 2023-07-11 14:27:05,237 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for 66e7b46b2c70aaaa5ed558bcfa8ac676 2023-07-11 14:27:05,237 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for 5a7a7878544668c682997c73147b1220 2023-07-11 14:27:05,237 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for ff6d38721d77dec2555b77bfec573075 2023-07-11 14:27:05,237 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for 6ae32d4e7367668541894e8f3c21c047 2023-07-11 14:27:05,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:27:05,237 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:05,237 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for a731373ce9dfd79d55495dd18431f095 2023-07-11 14:27:05,238 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for 2d05c9e5bd88a0debf2d4f4cab371c23 2023-07-11 14:27:05,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:27:05,238 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for ac77e8e2fc5f54d54be1f5c59a7a3d24 2023-07-11 14:27:05,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing dd06cff512fea186a79c12a85e039c36, disabling compactions & flushes 2023-07-11 14:27:05,238 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for 82a6a2c5d8b4f8de1fbd3bdd41150dab 2023-07-11 14:27:05,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. after waiting 0 ms 2023-07-11 14:27:05,238 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for 551dbd676cfcd99c09597e9fc5285210 2023-07-11 14:27:05,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:27:05,238 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for 5931619e05cf0cf890fb2bcad4916149 2023-07-11 14:27:05,238 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for ab932ae57850da80400237dc1b0b1b2f 2023-07-11 14:27:05,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 10dfb74a1a23ab15b405d903fdf243a0 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:27:05,238 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for ed162f49432e859aa69b9277091322c6 2023-07-11 14:27:05,238 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for 6c668c42743ec462b9ac68b0ac69bdad 2023-07-11 14:27:05,239 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:27:05,239 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for 6a5aca3163b7bef744905773179c5d09 2023-07-11 14:27:05,239 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for 98b0bf96f74236d0e5d66c8a4188e4cd 2023-07-11 14:27:05,239 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for 3300b91b6685c56113c82e496565fd11 2023-07-11 14:27:05,239 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:05,239 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(3305): Received CLOSE for 937337250fe5f867c4822d687fa0330e 2023-07-11 14:27:05,239 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:05,239 DEBUG [RS:2;jenkins-hbase9:36555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cd0f4da to 127.0.0.1:54666 2023-07-11 14:27:05,239 DEBUG [RS:2;jenkins-hbase9:36555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:27:05,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:27:05,239 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for 22b1c0abb82e1750694628a9ed9bc56b 2023-07-11 14:27:05,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. after waiting 0 ms 2023-07-11 14:27:05,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:27:05,239 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:05,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing dd06cff512fea186a79c12a85e039c36 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,240 DEBUG [RS:1;jenkins-hbase9:42425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bd96f42 to 127.0.0.1:54666 2023-07-11 14:27:05,240 DEBUG [RS:1;jenkins-hbase9:42425] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:27:05,242 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1474): Waiting on 13 regions to close 2023-07-11 14:27:05,242 INFO [RS:1;jenkins-hbase9:42425] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 14:27:05,242 INFO [RS:1;jenkins-hbase9:42425] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 14:27:05,242 INFO [RS:1;jenkins-hbase9:42425] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 14:27:05,242 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 14:27:05,242 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1474): Waiting on 15 regions to close 2023-07-11 14:27:05,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 14:27:05,243 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 14:27:05,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 14:27:05,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 14:27:05,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 14:27:05,243 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.55 KB heapSize=21.12 KB 2023-07-11 14:27:05,250 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1504): Waiting on 3300b91b6685c56113c82e496565fd11, 551dbd676cfcd99c09597e9fc5285210, 5931619e05cf0cf890fb2bcad4916149, 66e7b46b2c70aaaa5ed558bcfa8ac676, 6a5aca3163b7bef744905773179c5d09, 6c668c42743ec462b9ac68b0ac69bdad, 88a55364cb44dcda432e2854a92e01b4, 937337250fe5f867c4822d687fa0330e, 98b0bf96f74236d0e5d66c8a4188e4cd, a731373ce9dfd79d55495dd18431f095, d6012602a1d2ab18cd68f81a87b29d16, dd06cff512fea186a79c12a85e039c36, ff6d38721d77dec2555b77bfec573075 2023-07-11 14:27:05,250 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1504): Waiting on 10dfb74a1a23ab15b405d903fdf243a0, 1588230740, 22b1c0abb82e1750694628a9ed9bc56b, 2d05c9e5bd88a0debf2d4f4cab371c23, 5a7a7878544668c682997c73147b1220, 5b5d115c3d662e11393952c37d76b9b1, 6ae32d4e7367668541894e8f3c21c047, 82a6a2c5d8b4f8de1fbd3bdd41150dab, ab932ae57850da80400237dc1b0b1b2f, ac77e8e2fc5f54d54be1f5c59a7a3d24, bb4185ff2e7cde2bd90fe9e4a90b7943, d300c1c4be5195cf92faac67764ebb52, ec820b7b1bea419174597c47a0865f47, ed162f49432e859aa69b9277091322c6, fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:05,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=14.55 KB at sequenceid=86 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/.tmp/info/4a76e9c1b4ab441f9e6635fb9ef836a3 2023-07-11 14:27:05,309 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/.tmp/info/4a76e9c1b4ab441f9e6635fb9ef836a3 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/info/4a76e9c1b4ab441f9e6635fb9ef836a3 2023-07-11 14:27:05,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/.tmp/colfamily11/9f467b3242414c5db7ac2bedb6724480 2023-07-11 14:27:05,316 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/info/4a76e9c1b4ab441f9e6635fb9ef836a3, entries=80, sequenceid=86, filesize=19.5 K 2023-07-11 14:27:05,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/.tmp/colfamily11/9f467b3242414c5db7ac2bedb6724480 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/colfamily11/9f467b3242414c5db7ac2bedb6724480 2023-07-11 14:27:05,317 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.55 KB/14902, heapSize ~20.60 KB/21096, currentSize=0 B/0 for 1588230740 in 74ms, sequenceid=86, compaction requested=false 2023-07-11 14:27:05,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/.tmp/colfamily11/050e6de003d14507b3ac577b42cceaf2 2023-07-11 14:27:05,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/colfamily11/9f467b3242414c5db7ac2bedb6724480, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for dd06cff512fea186a79c12a85e039c36 in 90ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,331 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/meta/1588230740/recovered.edits/89.seqid, newMaxSeqId=89, maxSeqId=63 2023-07-11 14:27:05,332 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 14:27:05,333 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 14:27:05,333 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 14:27:05,333 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 14:27:05,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/dd06cff512fea186a79c12a85e039c36/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:27:05,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for dd06cff512fea186a79c12a85e039c36: 2023-07-11 14:27:05,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,kkk,1689085471576.dd06cff512fea186a79c12a85e039c36. 2023-07-11 14:27:05,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 88a55364cb44dcda432e2854a92e01b4, disabling compactions & flushes 2023-07-11 14:27:05,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:27:05,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:27:05,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. after waiting 0 ms 2023-07-11 14:27:05,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:27:05,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 88a55364cb44dcda432e2854a92e01b4 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/.tmp/colfamily11/050e6de003d14507b3ac577b42cceaf2 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/colfamily11/050e6de003d14507b3ac577b42cceaf2 2023-07-11 14:27:05,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/colfamily11/050e6de003d14507b3ac577b42cceaf2, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 10dfb74a1a23ab15b405d903fdf243a0 in 106ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/10dfb74a1a23ab15b405d903fdf243a0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:27:05,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 10dfb74a1a23ab15b405d903fdf243a0: 2023-07-11 14:27:05,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,qqq,1689085471576.10dfb74a1a23ab15b405d903fdf243a0. 2023-07-11 14:27:05,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ec820b7b1bea419174597c47a0865f47, disabling compactions & flushes 2023-07-11 14:27:05,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:27:05,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:27:05,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. after waiting 0 ms 2023-07-11 14:27:05,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:27:05,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ec820b7b1bea419174597c47a0865f47 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/.tmp/colfamily11/edada131ff8c4401a86858c35be947f2 2023-07-11 14:27:05,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/.tmp/colfamily11/edada131ff8c4401a86858c35be947f2 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/colfamily11/edada131ff8c4401a86858c35be947f2 2023-07-11 14:27:05,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/colfamily11/edada131ff8c4401a86858c35be947f2, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 88a55364cb44dcda432e2854a92e01b4 in 67ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/.tmp/colfamily11/64fc8b579d7743c9bf5d7d5cf167b278 2023-07-11 14:27:05,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/88a55364cb44dcda432e2854a92e01b4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:27:05,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 88a55364cb44dcda432e2854a92e01b4: 2023-07-11 14:27:05,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,nnn,1689085471576.88a55364cb44dcda432e2854a92e01b4. 2023-07-11 14:27:05,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 66e7b46b2c70aaaa5ed558bcfa8ac676, disabling compactions & flushes 2023-07-11 14:27:05,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:27:05,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:27:05,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. after waiting 0 ms 2023-07-11 14:27:05,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:27:05,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 66e7b46b2c70aaaa5ed558bcfa8ac676 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/.tmp/colfamily11/64fc8b579d7743c9bf5d7d5cf167b278 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/colfamily11/64fc8b579d7743c9bf5d7d5cf167b278 2023-07-11 14:27:05,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/colfamily11/64fc8b579d7743c9bf5d7d5cf167b278, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ec820b7b1bea419174597c47a0865f47 in 70ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,451 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1504): Waiting on 3300b91b6685c56113c82e496565fd11, 551dbd676cfcd99c09597e9fc5285210, 5931619e05cf0cf890fb2bcad4916149, 66e7b46b2c70aaaa5ed558bcfa8ac676, 6a5aca3163b7bef744905773179c5d09, 6c668c42743ec462b9ac68b0ac69bdad, 937337250fe5f867c4822d687fa0330e, 98b0bf96f74236d0e5d66c8a4188e4cd, a731373ce9dfd79d55495dd18431f095, d6012602a1d2ab18cd68f81a87b29d16, ff6d38721d77dec2555b77bfec573075 2023-07-11 14:27:05,451 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1504): Waiting on 22b1c0abb82e1750694628a9ed9bc56b, 2d05c9e5bd88a0debf2d4f4cab371c23, 5a7a7878544668c682997c73147b1220, 5b5d115c3d662e11393952c37d76b9b1, 6ae32d4e7367668541894e8f3c21c047, 82a6a2c5d8b4f8de1fbd3bdd41150dab, ab932ae57850da80400237dc1b0b1b2f, ac77e8e2fc5f54d54be1f5c59a7a3d24, bb4185ff2e7cde2bd90fe9e4a90b7943, d300c1c4be5195cf92faac67764ebb52, ec820b7b1bea419174597c47a0865f47, ed162f49432e859aa69b9277091322c6, fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:05,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ec820b7b1bea419174597c47a0865f47/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:27:05,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ec820b7b1bea419174597c47a0865f47: 2023-07-11 14:27:05,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,yyy,1689085471576.ec820b7b1bea419174597c47a0865f47. 2023-07-11 14:27:05,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing bb4185ff2e7cde2bd90fe9e4a90b7943, disabling compactions & flushes 2023-07-11 14:27:05,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:27:05,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:27:05,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. after waiting 0 ms 2023-07-11 14:27:05,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:27:05,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/.tmp/colfamily11/df9ba23c918a4fc8bdd13f5723b45a24 2023-07-11 14:27:05,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/bb4185ff2e7cde2bd90fe9e4a90b7943/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 14:27:05,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:27:05,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for bb4185ff2e7cde2bd90fe9e4a90b7943: 2023-07-11 14:27:05,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,zzz,1689085471576.bb4185ff2e7cde2bd90fe9e4a90b7943. 2023-07-11 14:27:05,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5b5d115c3d662e11393952c37d76b9b1, disabling compactions & flushes 2023-07-11 14:27:05,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:27:05,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:27:05,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. after waiting 0 ms 2023-07-11 14:27:05,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:27:05,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 5b5d115c3d662e11393952c37d76b9b1 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/.tmp/colfamily11/df9ba23c918a4fc8bdd13f5723b45a24 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/colfamily11/df9ba23c918a4fc8bdd13f5723b45a24 2023-07-11 14:27:05,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/colfamily11/df9ba23c918a4fc8bdd13f5723b45a24, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 66e7b46b2c70aaaa5ed558bcfa8ac676 in 76ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/66e7b46b2c70aaaa5ed558bcfa8ac676/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:27:05,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 66e7b46b2c70aaaa5ed558bcfa8ac676: 2023-07-11 14:27:05,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,bbb,1689085471576.66e7b46b2c70aaaa5ed558bcfa8ac676. 2023-07-11 14:27:05,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ff6d38721d77dec2555b77bfec573075, disabling compactions & flushes 2023-07-11 14:27:05,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:27:05,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:27:05,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. after waiting 0 ms 2023-07-11 14:27:05,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:27:05,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ff6d38721d77dec2555b77bfec573075 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/.tmp/colfamily11/076325ab0f5448ffa4b1704d6ec3c1b2 2023-07-11 14:27:05,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/.tmp/colfamily11/076325ab0f5448ffa4b1704d6ec3c1b2 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/colfamily11/076325ab0f5448ffa4b1704d6ec3c1b2 2023-07-11 14:27:05,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/colfamily11/076325ab0f5448ffa4b1704d6ec3c1b2, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 5b5d115c3d662e11393952c37d76b9b1 in 68ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/.tmp/colfamily11/341e84a12ca748afb13b42e327a633d4 2023-07-11 14:27:05,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5b5d115c3d662e11393952c37d76b9b1/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:27:05,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5b5d115c3d662e11393952c37d76b9b1: 2023-07-11 14:27:05,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,lll,1689085471576.5b5d115c3d662e11393952c37d76b9b1. 2023-07-11 14:27:05,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5a7a7878544668c682997c73147b1220, disabling compactions & flushes 2023-07-11 14:27:05,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:27:05,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:27:05,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. after waiting 0 ms 2023-07-11 14:27:05,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:27:05,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/.tmp/colfamily11/341e84a12ca748afb13b42e327a633d4 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/colfamily11/341e84a12ca748afb13b42e327a633d4 2023-07-11 14:27:05,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5a7a7878544668c682997c73147b1220/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 14:27:05,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:27:05,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5a7a7878544668c682997c73147b1220: 2023-07-11 14:27:05,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ccc,1689085471576.5a7a7878544668c682997c73147b1220. 2023-07-11 14:27:05,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 6ae32d4e7367668541894e8f3c21c047, disabling compactions & flushes 2023-07-11 14:27:05,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:27:05,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:27:05,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. after waiting 0 ms 2023-07-11 14:27:05,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:27:05,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 6ae32d4e7367668541894e8f3c21c047 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/colfamily11/341e84a12ca748afb13b42e327a633d4, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ff6d38721d77dec2555b77bfec573075 in 71ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ff6d38721d77dec2555b77bfec573075/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:27:05,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ff6d38721d77dec2555b77bfec573075: 2023-07-11 14:27:05,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,fff,1689085471576.ff6d38721d77dec2555b77bfec573075. 2023-07-11 14:27:05,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a731373ce9dfd79d55495dd18431f095, disabling compactions & flushes 2023-07-11 14:27:05,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:27:05,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:27:05,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. after waiting 0 ms 2023-07-11 14:27:05,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:27:05,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing a731373ce9dfd79d55495dd18431f095 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/.tmp/colfamily11/d6781f93dd8746deb4e2c631dd047378 2023-07-11 14:27:05,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/.tmp/colfamily11/d6781f93dd8746deb4e2c631dd047378 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/colfamily11/d6781f93dd8746deb4e2c631dd047378 2023-07-11 14:27:05,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/colfamily11/d6781f93dd8746deb4e2c631dd047378, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 6ae32d4e7367668541894e8f3c21c047 in 61ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,651 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1504): Waiting on 3300b91b6685c56113c82e496565fd11, 551dbd676cfcd99c09597e9fc5285210, 5931619e05cf0cf890fb2bcad4916149, 6a5aca3163b7bef744905773179c5d09, 6c668c42743ec462b9ac68b0ac69bdad, 937337250fe5f867c4822d687fa0330e, 98b0bf96f74236d0e5d66c8a4188e4cd, a731373ce9dfd79d55495dd18431f095, d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:05,651 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1504): Waiting on 22b1c0abb82e1750694628a9ed9bc56b, 2d05c9e5bd88a0debf2d4f4cab371c23, 6ae32d4e7367668541894e8f3c21c047, 82a6a2c5d8b4f8de1fbd3bdd41150dab, ab932ae57850da80400237dc1b0b1b2f, ac77e8e2fc5f54d54be1f5c59a7a3d24, d300c1c4be5195cf92faac67764ebb52, ed162f49432e859aa69b9277091322c6, fdb423248dfa9ba3bd628e031d476892 2023-07-11 14:27:05,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/.tmp/colfamily11/9aa6392ef365491bb55bb1bad5650977 2023-07-11 14:27:05,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/.tmp/colfamily11/9aa6392ef365491bb55bb1bad5650977 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/colfamily11/9aa6392ef365491bb55bb1bad5650977 2023-07-11 14:27:05,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6ae32d4e7367668541894e8f3c21c047/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:27:05,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 6ae32d4e7367668541894e8f3c21c047: 2023-07-11 14:27:05,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ooo,1689085471576.6ae32d4e7367668541894e8f3c21c047. 2023-07-11 14:27:05,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing fdb423248dfa9ba3bd628e031d476892, disabling compactions & flushes 2023-07-11 14:27:05,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:27:05,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:27:05,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. after waiting 0 ms 2023-07-11 14:27:05,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:27:05,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/colfamily11/9aa6392ef365491bb55bb1bad5650977, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for a731373ce9dfd79d55495dd18431f095 in 105ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/a731373ce9dfd79d55495dd18431f095/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/fdb423248dfa9ba3bd628e031d476892/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 14:27:05,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:27:05,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for fdb423248dfa9ba3bd628e031d476892: 2023-07-11 14:27:05,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,sss,1689085471576.fdb423248dfa9ba3bd628e031d476892. 2023-07-11 14:27:05,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2d05c9e5bd88a0debf2d4f4cab371c23, disabling compactions & flushes 2023-07-11 14:27:05,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:27:05,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:27:05,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a731373ce9dfd79d55495dd18431f095: 2023-07-11 14:27:05,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:27:05,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. after waiting 0 ms 2023-07-11 14:27:05,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,uuu,1689085471576.a731373ce9dfd79d55495dd18431f095. 2023-07-11 14:27:05,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:27:05,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 551dbd676cfcd99c09597e9fc5285210, disabling compactions & flushes 2023-07-11 14:27:05,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:27:05,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:27:05,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. after waiting 0 ms 2023-07-11 14:27:05,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:27:05,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 551dbd676cfcd99c09597e9fc5285210 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/2d05c9e5bd88a0debf2d4f4cab371c23/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 14:27:05,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:27:05,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2d05c9e5bd88a0debf2d4f4cab371c23: 2023-07-11 14:27:05,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,mmm,1689085471576.2d05c9e5bd88a0debf2d4f4cab371c23. 2023-07-11 14:27:05,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ac77e8e2fc5f54d54be1f5c59a7a3d24, disabling compactions & flushes 2023-07-11 14:27:05,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:27:05,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:27:05,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. after waiting 0 ms 2023-07-11 14:27:05,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:27:05,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ac77e8e2fc5f54d54be1f5c59a7a3d24 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/.tmp/colfamily11/b310947a68694cfcbf1e81082bc8b434 2023-07-11 14:27:05,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/.tmp/colfamily11/b310947a68694cfcbf1e81082bc8b434 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/colfamily11/b310947a68694cfcbf1e81082bc8b434 2023-07-11 14:27:05,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/.tmp/colfamily11/49ddaefd2b284fd69b3359bbbd5ad6b5 2023-07-11 14:27:05,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/colfamily11/b310947a68694cfcbf1e81082bc8b434, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/.tmp/colfamily11/49ddaefd2b284fd69b3359bbbd5ad6b5 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/colfamily11/49ddaefd2b284fd69b3359bbbd5ad6b5 2023-07-11 14:27:05,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 551dbd676cfcd99c09597e9fc5285210 in 59ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/colfamily11/49ddaefd2b284fd69b3359bbbd5ad6b5, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ac77e8e2fc5f54d54be1f5c59a7a3d24 in 48ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/551dbd676cfcd99c09597e9fc5285210/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,814 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 14:27:05,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:27:05,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 551dbd676cfcd99c09597e9fc5285210: 2023-07-11 14:27:05,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,xxx,1689085471576.551dbd676cfcd99c09597e9fc5285210. 2023-07-11 14:27:05,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5931619e05cf0cf890fb2bcad4916149, disabling compactions & flushes 2023-07-11 14:27:05,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:27:05,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:27:05,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. after waiting 0 ms 2023-07-11 14:27:05,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:27:05,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ac77e8e2fc5f54d54be1f5c59a7a3d24/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:27:05,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ac77e8e2fc5f54d54be1f5c59a7a3d24: 2023-07-11 14:27:05,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,hhh,1689085471576.ac77e8e2fc5f54d54be1f5c59a7a3d24. 2023-07-11 14:27:05,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 82a6a2c5d8b4f8de1fbd3bdd41150dab, disabling compactions & flushes 2023-07-11 14:27:05,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:27:05,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:27:05,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. after waiting 0 ms 2023-07-11 14:27:05,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:27:05,851 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1504): Waiting on 3300b91b6685c56113c82e496565fd11, 5931619e05cf0cf890fb2bcad4916149, 6a5aca3163b7bef744905773179c5d09, 6c668c42743ec462b9ac68b0ac69bdad, 937337250fe5f867c4822d687fa0330e, 98b0bf96f74236d0e5d66c8a4188e4cd, d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:05,851 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1504): Waiting on 22b1c0abb82e1750694628a9ed9bc56b, 82a6a2c5d8b4f8de1fbd3bdd41150dab, ab932ae57850da80400237dc1b0b1b2f, d300c1c4be5195cf92faac67764ebb52, ed162f49432e859aa69b9277091322c6 2023-07-11 14:27:05,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/5931619e05cf0cf890fb2bcad4916149/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 14:27:05,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:27:05,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5931619e05cf0cf890fb2bcad4916149: 2023-07-11 14:27:05,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ddd,1689085471576.5931619e05cf0cf890fb2bcad4916149. 2023-07-11 14:27:05,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 6c668c42743ec462b9ac68b0ac69bdad, disabling compactions & flushes 2023-07-11 14:27:05,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:27:05,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:27:05,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. after waiting 0 ms 2023-07-11 14:27:05,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:27:05,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/82a6a2c5d8b4f8de1fbd3bdd41150dab/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 14:27:05,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:27:05,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 82a6a2c5d8b4f8de1fbd3bdd41150dab: 2023-07-11 14:27:05,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,iii,1689085471576.82a6a2c5d8b4f8de1fbd3bdd41150dab. 2023-07-11 14:27:05,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ab932ae57850da80400237dc1b0b1b2f, disabling compactions & flushes 2023-07-11 14:27:05,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:27:05,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:27:05,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. after waiting 0 ms 2023-07-11 14:27:05,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:27:05,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ab932ae57850da80400237dc1b0b1b2f 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6c668c42743ec462b9ac68b0ac69bdad/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 14:27:05,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:27:05,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 6c668c42743ec462b9ac68b0ac69bdad: 2023-07-11 14:27:05,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,www,1689085471576.6c668c42743ec462b9ac68b0ac69bdad. 2023-07-11 14:27:05,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 6a5aca3163b7bef744905773179c5d09, disabling compactions & flushes 2023-07-11 14:27:05,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:27:05,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:27:05,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. after waiting 0 ms 2023-07-11 14:27:05,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:27:05,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 6a5aca3163b7bef744905773179c5d09 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/.tmp/colfamily11/3b15972d931a4d12babb1cedfb60c0a8 2023-07-11 14:27:05,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/.tmp/colfamily11/3b15972d931a4d12babb1cedfb60c0a8 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/colfamily11/3b15972d931a4d12babb1cedfb60c0a8 2023-07-11 14:27:05,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/colfamily11/3b15972d931a4d12babb1cedfb60c0a8, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ab932ae57850da80400237dc1b0b1b2f in 85ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/.tmp/colfamily11/d404da3699fb464dac5e84489402c166 2023-07-11 14:27:05,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ab932ae57850da80400237dc1b0b1b2f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/.tmp/colfamily11/d404da3699fb464dac5e84489402c166 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/colfamily11/d404da3699fb464dac5e84489402c166 2023-07-11 14:27:05,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:27:05,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ab932ae57850da80400237dc1b0b1b2f: 2023-07-11 14:27:05,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ttt,1689085471576.ab932ae57850da80400237dc1b0b1b2f. 2023-07-11 14:27:05,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ed162f49432e859aa69b9277091322c6, disabling compactions & flushes 2023-07-11 14:27:05,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:27:05,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:27:05,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. after waiting 0 ms 2023-07-11 14:27:05,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:27:05,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ed162f49432e859aa69b9277091322c6 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:05,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/colfamily11/d404da3699fb464dac5e84489402c166, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:05,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 6a5aca3163b7bef744905773179c5d09 in 79ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:05,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/6a5aca3163b7bef744905773179c5d09/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:05,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:27:05,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 6a5aca3163b7bef744905773179c5d09: 2023-07-11 14:27:05,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ggg,1689085471576.6a5aca3163b7bef744905773179c5d09. 2023-07-11 14:27:05,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 98b0bf96f74236d0e5d66c8a4188e4cd, disabling compactions & flushes 2023-07-11 14:27:05,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:27:06,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:27:06,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. after waiting 0 ms 2023-07-11 14:27:06,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:27:06,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 98b0bf96f74236d0e5d66c8a4188e4cd 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:06,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/.tmp/colfamily11/258812bce608463a821aac1584bf0022 2023-07-11 14:27:06,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/.tmp/colfamily11/258812bce608463a821aac1584bf0022 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/colfamily11/258812bce608463a821aac1584bf0022 2023-07-11 14:27:06,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/.tmp/colfamily11/4341d19070994c2cb6bd664d9d63dc95 2023-07-11 14:27:06,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/colfamily11/258812bce608463a821aac1584bf0022, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:06,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for ed162f49432e859aa69b9277091322c6 in 50ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:06,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/.tmp/colfamily11/4341d19070994c2cb6bd664d9d63dc95 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/colfamily11/4341d19070994c2cb6bd664d9d63dc95 2023-07-11 14:27:06,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/ed162f49432e859aa69b9277091322c6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:06,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:27:06,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ed162f49432e859aa69b9277091322c6: 2023-07-11 14:27:06,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,eee,1689085471576.ed162f49432e859aa69b9277091322c6. 2023-07-11 14:27:06,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d300c1c4be5195cf92faac67764ebb52, disabling compactions & flushes 2023-07-11 14:27:06,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:27:06,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:27:06,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. after waiting 0 ms 2023-07-11 14:27:06,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:27:06,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing d300c1c4be5195cf92faac67764ebb52 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:06,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/colfamily11/4341d19070994c2cb6bd664d9d63dc95, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:06,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 98b0bf96f74236d0e5d66c8a4188e4cd in 47ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:06,051 DEBUG [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1504): Waiting on 3300b91b6685c56113c82e496565fd11, 937337250fe5f867c4822d687fa0330e, 98b0bf96f74236d0e5d66c8a4188e4cd, d6012602a1d2ab18cd68f81a87b29d16 2023-07-11 14:27:06,052 DEBUG [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1504): Waiting on 22b1c0abb82e1750694628a9ed9bc56b, d300c1c4be5195cf92faac67764ebb52 2023-07-11 14:27:06,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/98b0bf96f74236d0e5d66c8a4188e4cd/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:06,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:27:06,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 98b0bf96f74236d0e5d66c8a4188e4cd: 2023-07-11 14:27:06,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,rrr,1689085471576.98b0bf96f74236d0e5d66c8a4188e4cd. 2023-07-11 14:27:06,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3300b91b6685c56113c82e496565fd11, disabling compactions & flushes 2023-07-11 14:27:06,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:27:06,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:27:06,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. after waiting 0 ms 2023-07-11 14:27:06,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:27:06,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/.tmp/colfamily11/c98a31122eaf4a37b32287c879223678 2023-07-11 14:27:06,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/hbase/namespace/3300b91b6685c56113c82e496565fd11/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=5 2023-07-11 14:27:06,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:27:06,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3300b91b6685c56113c82e496565fd11: 2023-07-11 14:27:06,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689085470785.3300b91b6685c56113c82e496565fd11. 2023-07-11 14:27:06,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d6012602a1d2ab18cd68f81a87b29d16, disabling compactions & flushes 2023-07-11 14:27:06,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:27:06,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:27:06,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. after waiting 0 ms 2023-07-11 14:27:06,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:27:06,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d6012602a1d2ab18cd68f81a87b29d16/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 14:27:06,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:27:06,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d6012602a1d2ab18cd68f81a87b29d16: 2023-07-11 14:27:06,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,jjj,1689085471576.d6012602a1d2ab18cd68f81a87b29d16. 2023-07-11 14:27:06,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 937337250fe5f867c4822d687fa0330e, disabling compactions & flushes 2023-07-11 14:27:06,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:27:06,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:27:06,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. after waiting 0 ms 2023-07-11 14:27:06,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:27:06,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/937337250fe5f867c4822d687fa0330e/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 14:27:06,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:27:06,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 937337250fe5f867c4822d687fa0330e: 2023-07-11 14:27:06,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,ppp,1689085471576.937337250fe5f867c4822d687fa0330e. 2023-07-11 14:27:06,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/.tmp/colfamily11/c98a31122eaf4a37b32287c879223678 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/colfamily11/c98a31122eaf4a37b32287c879223678 2023-07-11 14:27:06,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/colfamily11/c98a31122eaf4a37b32287c879223678, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:06,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for d300c1c4be5195cf92faac67764ebb52 in 58ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:06,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/d300c1c4be5195cf92faac67764ebb52/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:06,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:27:06,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d300c1c4be5195cf92faac67764ebb52: 2023-07-11 14:27:06,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,,1689085471576.d300c1c4be5195cf92faac67764ebb52. 2023-07-11 14:27:06,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 22b1c0abb82e1750694628a9ed9bc56b, disabling compactions & flushes 2023-07-11 14:27:06,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:27:06,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:27:06,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. after waiting 0 ms 2023-07-11 14:27:06,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:27:06,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 22b1c0abb82e1750694628a9ed9bc56b 3/3 column families, dataSize=32.95 KB heapSize=83.13 KB 2023-07-11 14:27:06,115 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 14:27:06,115 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 14:27:06,116 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 14:27:06,116 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 14:27:06,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32.95 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/.tmp/colfamily11/edc9e546004c44a2b2c39662dc926ba3 2023-07-11 14:27:06,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/.tmp/colfamily11/edc9e546004c44a2b2c39662dc926ba3 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/colfamily11/edc9e546004c44a2b2c39662dc926ba3 2023-07-11 14:27:06,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/colfamily11/edc9e546004c44a2b2c39662dc926ba3, entries=703, sequenceid=5, filesize=38.2 K 2023-07-11 14:27:06,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32.95 KB/33744, heapSize ~82.62 KB/84600, currentSize=0 B/0 for 22b1c0abb82e1750694628a9ed9bc56b in 45ms, sequenceid=5, compaction requested=false 2023-07-11 14:27:06,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/data/default/testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true/22b1c0abb82e1750694628a9ed9bc56b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 14:27:06,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:27:06,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 22b1c0abb82e1750694628a9ed9bc56b: 2023-07-11 14:27:06,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testRecoveryAndDoubleExecution-carryingMeta-true-doubleExecution-true,vvv,1689085471576.22b1c0abb82e1750694628a9ed9bc56b. 2023-07-11 14:27:06,252 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,36555,1689085468888; all regions closed. 2023-07-11 14:27:06,252 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,42425,1689085468855; all regions closed. 2023-07-11 14:27:06,263 DEBUG [RS:2;jenkins-hbase9:36555] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/oldWALs 2023-07-11 14:27:06,263 INFO [RS:2;jenkins-hbase9:36555] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C36555%2C1689085468888:(num 1689085470283) 2023-07-11 14:27:06,263 DEBUG [RS:2;jenkins-hbase9:36555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:27:06,263 INFO [RS:2;jenkins-hbase9:36555] regionserver.LeaseManager(133): Closed leases 2023-07-11 14:27:06,263 INFO [RS:2;jenkins-hbase9:36555] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 14:27:06,264 INFO [RS:2;jenkins-hbase9:36555] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 14:27:06,264 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 14:27:06,264 INFO [RS:2;jenkins-hbase9:36555] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 14:27:06,264 INFO [RS:2;jenkins-hbase9:36555] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 14:27:06,265 INFO [RS:2;jenkins-hbase9:36555] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:36555 2023-07-11 14:27:06,271 DEBUG [RS:1;jenkins-hbase9:42425] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/oldWALs 2023-07-11 14:27:06,271 INFO [RS:1;jenkins-hbase9:42425] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C42425%2C1689085468855.meta:.meta(num 1689085620172) 2023-07-11 14:27:06,276 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:27:06,276 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:06,276 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,36555,1689085468888 2023-07-11 14:27:06,276 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:27:06,276 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:27:06,277 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,36555,1689085468888] 2023-07-11 14:27:06,277 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,36555,1689085468888; numProcessing=1 2023-07-11 14:27:06,278 DEBUG [RS:1;jenkins-hbase9:42425] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/oldWALs 2023-07-11 14:27:06,278 INFO [RS:1;jenkins-hbase9:42425] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C42425%2C1689085468855:(num 1689085470282) 2023-07-11 14:27:06,278 DEBUG [RS:1;jenkins-hbase9:42425] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:27:06,278 INFO [RS:1;jenkins-hbase9:42425] regionserver.LeaseManager(133): Closed leases 2023-07-11 14:27:06,278 INFO [RS:1;jenkins-hbase9:42425] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 14:27:06,279 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 14:27:06,279 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,36555,1689085468888 already deleted, retry=false 2023-07-11 14:27:06,279 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,36555,1689085468888 expired; onlineServers=1 2023-07-11 14:27:06,279 INFO [RS:1;jenkins-hbase9:42425] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:42425 2023-07-11 14:27:06,285 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 14:27:06,286 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,42425,1689085468855 2023-07-11 14:27:06,286 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,42425,1689085468855] 2023-07-11 14:27:06,286 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,42425,1689085468855; numProcessing=2 2023-07-11 14:27:06,290 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,42425,1689085468855 already deleted, retry=false 2023-07-11 14:27:06,290 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,42425,1689085468855 expired; onlineServers=0 2023-07-11 14:27:06,290 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,33119,1689085467657' ***** 2023-07-11 14:27:06,290 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 14:27:06,290 DEBUG [M:0;jenkins-hbase9:33119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7df35757, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 14:27:06,290 INFO [M:0;jenkins-hbase9:33119] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,33119,1689085467657 2023-07-11 14:27:06,290 INFO [M:0;jenkins-hbase9:33119] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,33119,1689085467657; all regions closed. 2023-07-11 14:27:06,291 DEBUG [M:0;jenkins-hbase9:33119] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 14:27:06,291 DEBUG [M:0;jenkins-hbase9:33119] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 14:27:06,291 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 14:27:06,291 DEBUG [M:0;jenkins-hbase9:33119] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 14:27:06,291 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689085469952] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689085469952,5,FailOnTimeoutGroup] 2023-07-11 14:27:06,291 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689085469952] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689085469952,5,FailOnTimeoutGroup] 2023-07-11 14:27:06,291 INFO [M:0;jenkins-hbase9:33119] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 14:27:06,291 INFO [M:0;jenkins-hbase9:33119] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 14:27:06,292 INFO [M:0;jenkins-hbase9:33119] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-11 14:27:06,292 DEBUG [M:0;jenkins-hbase9:33119] master.HMaster(1512): Stopping service threads 2023-07-11 14:27:06,292 INFO [M:0;jenkins-hbase9:33119] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 14:27:06,293 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 14:27:06,293 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 14:27:06,294 ERROR [M:0;jenkins-hbase9:33119] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 14:27:06,294 INFO [M:0;jenkins-hbase9:33119] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 14:27:06,294 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 14:27:06,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 14:27:06,295 DEBUG [M:0;jenkins-hbase9:33119] zookeeper.ZKUtil(398): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 14:27:06,295 WARN [M:0;jenkins-hbase9:33119] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 14:27:06,295 INFO [M:0;jenkins-hbase9:33119] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 14:27:06,296 INFO [M:0;jenkins-hbase9:33119] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 14:27:06,296 DEBUG [M:0;jenkins-hbase9:33119] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 14:27:06,296 INFO [M:0;jenkins-hbase9:33119] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:27:06,296 DEBUG [M:0;jenkins-hbase9:33119] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:27:06,296 DEBUG [M:0;jenkins-hbase9:33119] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 14:27:06,296 DEBUG [M:0;jenkins-hbase9:33119] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:27:06,296 INFO [M:0;jenkins-hbase9:33119] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=341.61 KB heapSize=398.77 KB 2023-07-11 14:27:06,323 INFO [M:0;jenkins-hbase9:33119] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=341.61 KB at sequenceid=609 (bloomFilter=true), to=hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/53f99ee054644613ab028b1b0ab00020 2023-07-11 14:27:06,330 DEBUG [M:0;jenkins-hbase9:33119] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/53f99ee054644613ab028b1b0ab00020 as hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/53f99ee054644613ab028b1b0ab00020 2023-07-11 14:27:06,336 INFO [M:0;jenkins-hbase9:33119] regionserver.HStore(1080): Added hdfs://localhost:37125/user/jenkins/test-data/18df8d7b-34cc-db54-0dfd-9f99be7dee59/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/53f99ee054644613ab028b1b0ab00020, entries=88, sequenceid=609, filesize=14.3 K 2023-07-11 14:27:06,337 INFO [M:0;jenkins-hbase9:33119] regionserver.HRegion(2948): Finished flush of dataSize ~341.61 KB/349812, heapSize ~398.75 KB/408320, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 41ms, sequenceid=609, compaction requested=false 2023-07-11 14:27:06,339 INFO [M:0;jenkins-hbase9:33119] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 14:27:06,339 DEBUG [M:0;jenkins-hbase9:33119] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 14:27:06,346 INFO [M:0;jenkins-hbase9:33119] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 14:27:06,346 INFO [M:0;jenkins-hbase9:33119] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:33119 2023-07-11 14:27:06,347 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 14:27:06,349 DEBUG [M:0;jenkins-hbase9:33119] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,33119,1689085467657 already deleted, retry=false 2023-07-11 14:27:06,378 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:27:06,378 INFO [RS:2;jenkins-hbase9:36555] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,36555,1689085468888; zookeeper connection closed. 2023-07-11 14:27:06,378 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:36555-0x10154b79c630003, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:27:06,387 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@545a1f12] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@545a1f12 2023-07-11 14:27:06,479 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:27:06,479 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): master:33119-0x10154b79c630000, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:27:06,479 INFO [M:0;jenkins-hbase9:33119] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,33119,1689085467657; zookeeper connection closed. 2023-07-11 14:27:06,579 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:27:06,579 INFO [RS:1;jenkins-hbase9:42425] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,42425,1689085468855; zookeeper connection closed. 2023-07-11 14:27:06,579 DEBUG [Listener at localhost/44653-EventThread] zookeeper.ZKWatcher(600): regionserver:42425-0x10154b79c630002, quorum=127.0.0.1:54666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 14:27:06,580 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@27786589] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@27786589 2023-07-11 14:27:06,580 INFO [Listener at localhost/44653] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-11 14:27:06,580 WARN [Listener at localhost/44653] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 14:27:06,583 INFO [Listener at localhost/44653] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 14:27:06,687 WARN [BP-341162719-172.31.2.10-1689085464591 heartbeating to localhost/127.0.0.1:37125] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 14:27:06,687 WARN [BP-341162719-172.31.2.10-1689085464591 heartbeating to localhost/127.0.0.1:37125] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-341162719-172.31.2.10-1689085464591 (Datanode Uuid 3b380198-92da-4283-8c58-677877b807ad) service to localhost/127.0.0.1:37125 2023-07-11 14:27:06,689 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/cluster_74358967-39f9-bc17-2d36-57688478b8aa/dfs/data/data5/current/BP-341162719-172.31.2.10-1689085464591] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 14:27:06,689 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/cluster_74358967-39f9-bc17-2d36-57688478b8aa/dfs/data/data6/current/BP-341162719-172.31.2.10-1689085464591] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 14:27:06,691 WARN [Listener at localhost/44653] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 14:27:06,698 INFO [Listener at localhost/44653] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 14:27:06,803 WARN [BP-341162719-172.31.2.10-1689085464591 heartbeating to localhost/127.0.0.1:37125] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 14:27:06,803 WARN [BP-341162719-172.31.2.10-1689085464591 heartbeating to localhost/127.0.0.1:37125] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-341162719-172.31.2.10-1689085464591 (Datanode Uuid 0fe677a8-c1f0-49cd-902f-ee596929a11b) service to localhost/127.0.0.1:37125 2023-07-11 14:27:06,804 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/cluster_74358967-39f9-bc17-2d36-57688478b8aa/dfs/data/data3/current/BP-341162719-172.31.2.10-1689085464591] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 14:27:06,804 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/cluster_74358967-39f9-bc17-2d36-57688478b8aa/dfs/data/data4/current/BP-341162719-172.31.2.10-1689085464591] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 14:27:06,805 WARN [Listener at localhost/44653] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 14:27:06,807 INFO [Listener at localhost/44653] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 14:27:06,910 WARN [BP-341162719-172.31.2.10-1689085464591 heartbeating to localhost/127.0.0.1:37125] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 14:27:06,910 WARN [BP-341162719-172.31.2.10-1689085464591 heartbeating to localhost/127.0.0.1:37125] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-341162719-172.31.2.10-1689085464591 (Datanode Uuid a1f048c8-f8cd-48b3-b954-bbf81a4a8e67) service to localhost/127.0.0.1:37125 2023-07-11 14:27:06,910 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/cluster_74358967-39f9-bc17-2d36-57688478b8aa/dfs/data/data1/current/BP-341162719-172.31.2.10-1689085464591] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 14:27:06,911 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04134329-d29e-dd4c-7253-c2595c425ad4/cluster_74358967-39f9-bc17-2d36-57688478b8aa/dfs/data/data2/current/BP-341162719-172.31.2.10-1689085464591] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 14:27:06,938 INFO [Listener at localhost/44653] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 14:27:07,065 INFO [Listener at localhost/44653] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 14:27:07,145 INFO [Listener at localhost/44653] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-11 14:27:07,158 INFO [Listener at localhost/44653] hbase.ResourceChecker(175): after: master.procedure.TestSCPWithMeta#testRecoveryAndDoubleExecutionOnRsWithMeta Thread=76 (was 9) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1140398357) connection to localhost/127.0.0.1:37125 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:37125 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1140398357) connection to localhost/127.0.0.1:37125 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: regionserver/jenkins-hbase9:0.Chore.1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReplicationExecutor-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase9:0.logRoller java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.wal.AbstractWALRoller.run(AbstractWALRoller.java:179) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37125 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_META-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1140398357) connection to localhost/127.0.0.1:37125 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1140398357) connection to localhost/127.0.0.1:37125 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@1a0b8888 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Abort regionserver monitor java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:37125 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase9:38737Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-5-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44653 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) - Thread LEAK? -, OpenFileDescriptor=532 (was 256) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=114 (was 229), ProcessCount=169 (was 170), AvailableMemoryMB=7272 (was 8151)