2023-07-12 18:31:07,387 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153 2023-07-12 18:31:07,395 INFO [main] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-log-dir so I do NOT create it in target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b 2023-07-12 18:31:07,395 WARN [main] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-log-dir Erasing configuration value by system value. 2023-07-12 18:31:07,395 INFO [main] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-tmp-dir so I do NOT create it in target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b 2023-07-12 18:31:07,396 WARN [main] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-tmp-dir Erasing configuration value by system value. 2023-07-12 18:31:07,396 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b 2023-07-12 18:31:07,407 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool timeout: 13 mins 2023-07-12 18:31:07,434 INFO [Time-limited test] hbase.ResourceChecker(147): before: replication.TestReplicationSyncUpTool#testSyncUpTool Thread=10, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=147, ProcessCount=164, AvailableMemoryMB=6955 2023-07-12 18:31:07,444 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-log-dir so I do NOT create it in target/test-data/98e40eef-5de0-e812-7964-10490d2ae2a8 2023-07-12 18:31:07,445 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-log-dir Erasing configuration value by system value. 2023-07-12 18:31:07,445 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-tmp-dir so I do NOT create it in target/test-data/98e40eef-5de0-e812-7964-10490d2ae2a8 2023-07-12 18:31:07,445 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-tmp-dir Erasing configuration value by system value. 2023-07-12 18:31:07,445 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/98e40eef-5de0-e812-7964-10490d2ae2a8 2023-07-12 18:31:07,451 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-log-dir so I do NOT create it in target/test-data/0ae28ba4-f021-e33f-3dcf-05a79ef08ede 2023-07-12 18:31:07,452 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-log-dir Erasing configuration value by system value. 2023-07-12 18:31:07,452 INFO [Time-limited test] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-tmp-dir so I do NOT create it in target/test-data/0ae28ba4-f021-e33f-3dcf-05a79ef08ede 2023-07-12 18:31:07,452 WARN [Time-limited test] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop-tmp-dir Erasing configuration value by system value. 2023-07-12 18:31:07,452 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ae28ba4-f021-e33f-3dcf-05a79ef08ede 2023-07-12 18:31:07,455 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/cluster_5a761d4b-073d-2fda-f65b-7c1d3c830910, deleteOnExit=true 2023-07-12 18:31:07,557 INFO [Time-limited test] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/cluster_5a761d4b-073d-2fda-f65b-7c1d3c830910/zookeeper_0, clientPort=64028, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/cluster_5a761d4b-073d-2fda-f65b-7c1d3c830910/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/cluster_5a761d4b-073d-2fda-f65b-7c1d3c830910/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 18:31:07,572 INFO [Time-limited test] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64028 2023-07-12 18:31:07,576 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 18:31:07,576 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 18:31:07,576 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/test.cache.data in system properties and HBase conf 2023-07-12 18:31:07,576 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 18:31:07,577 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/hadoop.log.dir in system properties and HBase conf 2023-07-12 18:31:07,577 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 18:31:07,577 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 18:31:07,578 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 18:31:07,658 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 18:31:07,973 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 18:31:07,977 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:31:07,978 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:31:07,978 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 18:31:07,979 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:31:07,979 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 18:31:07,979 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 18:31:07,980 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:31:07,980 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:31:07,980 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 18:31:07,981 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/nfs.dump.dir in system properties and HBase conf 2023-07-12 18:31:07,981 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/java.io.tmpdir in system properties and HBase conf 2023-07-12 18:31:07,981 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:31:07,982 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 18:31:07,982 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 18:31:08,403 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 18:31:08,406 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 18:31:08,633 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 18:31:08,761 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 18:31:08,774 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:31:08,809 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:31:08,836 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/java.io.tmpdir/Jetty_localhost_localdomain_45145_hdfs____6pozsb/webapp 2023-07-12 18:31:08,938 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:45145 2023-07-12 18:31:08,945 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 18:31:08,945 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 18:31:09,302 WARN [Listener at localhost.localdomain/33763] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:31:09,391 WARN [Listener at localhost.localdomain/33763] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:31:09,412 WARN [Listener at localhost.localdomain/33763] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:31:09,419 INFO [Listener at localhost.localdomain/33763] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:31:09,426 INFO [Listener at localhost.localdomain/33763] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/java.io.tmpdir/Jetty_localhost_43465_datanode____d3z6rf/webapp 2023-07-12 18:31:09,513 INFO [Listener at localhost.localdomain/33763] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43465 2023-07-12 18:31:09,812 WARN [Listener at localhost.localdomain/36261] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:31:09,824 WARN [Listener at localhost.localdomain/36261] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:31:09,829 WARN [Listener at localhost.localdomain/36261] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:31:09,832 INFO [Listener at localhost.localdomain/36261] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:31:09,838 INFO [Listener at localhost.localdomain/36261] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/java.io.tmpdir/Jetty_localhost_40585_datanode____.odozs3/webapp 2023-07-12 18:31:09,920 INFO [Listener at localhost.localdomain/36261] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40585 2023-07-12 18:31:09,934 WARN [Listener at localhost.localdomain/38071] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:31:10,221 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xab00b7f41bbe5252: Processing first storage report for DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4 from datanode b49455b8-bcda-4810-925a-cb679b05301f 2023-07-12 18:31:10,222 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xab00b7f41bbe5252: from storage DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4 node DatanodeRegistration(127.0.0.1:46573, datanodeUuid=b49455b8-bcda-4810-925a-cb679b05301f, infoPort=41585, infoSecurePort=0, ipcPort=38071, storageInfo=lv=-57;cid=testClusterID;nsid=1883447549;c=1689186668462), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 18:31:10,223 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b354699efc45b19: Processing first storage report for DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424 from datanode a946c2f3-5bac-48a8-97af-732bed2d5f96 2023-07-12 18:31:10,223 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b354699efc45b19: from storage DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424 node DatanodeRegistration(127.0.0.1:34371, datanodeUuid=a946c2f3-5bac-48a8-97af-732bed2d5f96, infoPort=33223, infoSecurePort=0, ipcPort=36261, storageInfo=lv=-57;cid=testClusterID;nsid=1883447549;c=1689186668462), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:31:10,223 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xab00b7f41bbe5252: Processing first storage report for DS-80a25085-d86e-43d7-a702-69c6c3d252e4 from datanode b49455b8-bcda-4810-925a-cb679b05301f 2023-07-12 18:31:10,223 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xab00b7f41bbe5252: from storage DS-80a25085-d86e-43d7-a702-69c6c3d252e4 node DatanodeRegistration(127.0.0.1:46573, datanodeUuid=b49455b8-bcda-4810-925a-cb679b05301f, infoPort=41585, infoSecurePort=0, ipcPort=38071, storageInfo=lv=-57;cid=testClusterID;nsid=1883447549;c=1689186668462), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 18:31:10,224 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b354699efc45b19: Processing first storage report for DS-4dac6957-fd97-4612-90e9-d9a15cfddab7 from datanode a946c2f3-5bac-48a8-97af-732bed2d5f96 2023-07-12 18:31:10,224 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b354699efc45b19: from storage DS-4dac6957-fd97-4612-90e9-d9a15cfddab7 node DatanodeRegistration(127.0.0.1:34371, datanodeUuid=a946c2f3-5bac-48a8-97af-732bed2d5f96, infoPort=33223, infoSecurePort=0, ipcPort=36261, storageInfo=lv=-57;cid=testClusterID;nsid=1883447549;c=1689186668462), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:31:10,321 DEBUG [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153 2023-07-12 18:31:10,330 INFO [Listener at localhost.localdomain/38071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:10,333 INFO [Listener at localhost.localdomain/38071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:10,958 INFO [Listener at localhost.localdomain/38071] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347 with version=8 2023-07-12 18:31:10,958 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/hbase-staging 2023-07-12 18:31:11,200 INFO [Listener at localhost.localdomain/38071] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 18:31:11,587 INFO [Listener at localhost.localdomain/38071] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 18:31:11,613 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:11,613 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:11,613 INFO [Listener at localhost.localdomain/38071] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:11,613 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:11,614 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:11,746 INFO [Listener at localhost.localdomain/38071] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:11,814 DEBUG [Listener at localhost.localdomain/38071] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 18:31:11,921 INFO [Listener at localhost.localdomain/38071] ipc.NettyRpcServer(120): Bind to /148.251.75.209:40897 2023-07-12 18:31:11,932 INFO [Listener at localhost.localdomain/38071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:11,934 INFO [Listener at localhost.localdomain/38071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:11,952 INFO [Listener at localhost.localdomain/38071] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40897 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:11,988 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:408970x0, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:11,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40897-0x1008273886f0000 connected 2023-07-12 18:31:12,020 DEBUG [Listener at localhost.localdomain/38071] zookeeper.ZKUtil(164): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/master 2023-07-12 18:31:12,021 DEBUG [Listener at localhost.localdomain/38071] zookeeper.ZKUtil(164): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/running 2023-07-12 18:31:12,026 DEBUG [Listener at localhost.localdomain/38071] zookeeper.ZKUtil(164): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/acl 2023-07-12 18:31:12,033 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40897 2023-07-12 18:31:12,034 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40897 2023-07-12 18:31:12,034 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40897 2023-07-12 18:31:12,035 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40897 2023-07-12 18:31:12,035 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40897 2023-07-12 18:31:12,039 INFO [Listener at localhost.localdomain/38071] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347, hbase.cluster.distributed=false 2023-07-12 18:31:12,112 INFO [Listener at localhost.localdomain/38071] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 18:31:12,113 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:12,113 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:12,113 INFO [Listener at localhost.localdomain/38071] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:12,113 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:12,113 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:12,117 INFO [Listener at localhost.localdomain/38071] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:12,120 INFO [Listener at localhost.localdomain/38071] ipc.NettyRpcServer(120): Bind to /148.251.75.209:40805 2023-07-12 18:31:12,123 INFO [Listener at localhost.localdomain/38071] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:31:12,128 DEBUG [Listener at localhost.localdomain/38071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:31:12,129 INFO [Listener at localhost.localdomain/38071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:12,131 INFO [Listener at localhost.localdomain/38071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:12,133 INFO [Listener at localhost.localdomain/38071] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40805 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:12,137 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:408050x0, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:12,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40805-0x1008273886f0001 connected 2023-07-12 18:31:12,139 DEBUG [Listener at localhost.localdomain/38071] zookeeper.ZKUtil(164): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/master 2023-07-12 18:31:12,140 DEBUG [Listener at localhost.localdomain/38071] zookeeper.ZKUtil(164): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/running 2023-07-12 18:31:12,141 DEBUG [Listener at localhost.localdomain/38071] zookeeper.ZKUtil(164): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/acl 2023-07-12 18:31:12,141 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40805 2023-07-12 18:31:12,142 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40805 2023-07-12 18:31:12,143 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40805 2023-07-12 18:31:12,143 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40805 2023-07-12 18:31:12,144 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40805 2023-07-12 18:31:12,155 INFO [Listener at localhost.localdomain/38071] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 18:31:12,155 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:12,155 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:12,156 INFO [Listener at localhost.localdomain/38071] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:12,156 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:12,156 INFO [Listener at localhost.localdomain/38071] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:12,156 INFO [Listener at localhost.localdomain/38071] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:12,158 INFO [Listener at localhost.localdomain/38071] ipc.NettyRpcServer(120): Bind to /148.251.75.209:37271 2023-07-12 18:31:12,158 INFO [Listener at localhost.localdomain/38071] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:31:12,162 DEBUG [Listener at localhost.localdomain/38071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:31:12,163 INFO [Listener at localhost.localdomain/38071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:12,165 INFO [Listener at localhost.localdomain/38071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:12,168 INFO [Listener at localhost.localdomain/38071] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37271 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:12,172 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:372710x0, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:12,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37271-0x1008273886f0002 connected 2023-07-12 18:31:12,174 DEBUG [Listener at localhost.localdomain/38071] zookeeper.ZKUtil(164): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/master 2023-07-12 18:31:12,175 DEBUG [Listener at localhost.localdomain/38071] zookeeper.ZKUtil(164): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/running 2023-07-12 18:31:12,176 DEBUG [Listener at localhost.localdomain/38071] zookeeper.ZKUtil(164): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/acl 2023-07-12 18:31:12,176 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37271 2023-07-12 18:31:12,177 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37271 2023-07-12 18:31:12,177 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37271 2023-07-12 18:31:12,179 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37271 2023-07-12 18:31:12,179 DEBUG [Listener at localhost.localdomain/38071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37271 2023-07-12 18:31:12,183 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /1/backup-masters/jenkins-hbase20.apache.org,40897,1689186671073 2023-07-12 18:31:12,192 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/backup-masters 2023-07-12 18:31:12,194 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/backup-masters/jenkins-hbase20.apache.org,40897,1689186671073 2023-07-12 18:31:12,213 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/1/master 2023-07-12 18:31:12,213 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/1/master 2023-07-12 18:31:12,213 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/1/master 2023-07-12 18:31:12,213 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:12,214 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/master 2023-07-12 18:31:12,216 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /1/backup-masters/jenkins-hbase20.apache.org,40897,1689186671073 from backup master directory 2023-07-12 18:31:12,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/master 2023-07-12 18:31:12,218 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/backup-masters/jenkins-hbase20.apache.org,40897,1689186671073 2023-07-12 18:31:12,218 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/backup-masters 2023-07-12 18:31:12,219 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:12,219 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,40897,1689186671073 2023-07-12 18:31:12,222 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 18:31:12,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 18:31:12,307 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/hbase.id with ID: 23c3b538-bf67-481b-8351-f0e7ae087693 2023-07-12 18:31:12,361 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:12,384 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:12,440 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x341bcbb3 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:12,479 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68fa2e23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:12,504 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:12,506 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 18:31:12,526 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 18:31:12,526 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 18:31:12,527 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 18:31:12,531 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 18:31:12,532 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:12,565 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store-tmp 2023-07-12 18:31:12,603 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:12,604 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 18:31:12,604 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:12,604 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:12,604 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 18:31:12,604 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:12,604 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:12,604 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:31:12,607 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,40897,1689186671073 2023-07-12 18:31:12,635 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40897%2C1689186671073, suffix=, logDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,40897,1689186671073, archiveDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/oldWALs, maxLogs=10 2023-07-12 18:31:12,705 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK] 2023-07-12 18:31:12,705 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK] 2023-07-12 18:31:12,714 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 18:31:12,773 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,40897,1689186671073/jenkins-hbase20.apache.org%2C40897%2C1689186671073.1689186672648 2023-07-12 18:31:12,773 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK], DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK]] 2023-07-12 18:31:12,774 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:12,774 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:12,777 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:12,778 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:12,838 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:12,846 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 18:31:12,868 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 18:31:12,880 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:12,888 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:12,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:12,909 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:12,916 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:31:12,918 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75301456, jitterRate=0.12207913398742676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:31:12,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:31:12,920 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 18:31:12,942 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 18:31:12,942 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 18:31:12,944 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 18:31:12,953 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 8 msec 2023-07-12 18:31:12,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 44 msec 2023-07-12 18:31:12,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 18:31:13,026 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 18:31:13,034 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 18:31:13,069 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 18:31:13,074 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 18:31:13,075 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/balancer 2023-07-12 18:31:13,082 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 18:31:13,088 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/normalizer 2023-07-12 18:31:13,090 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:13,092 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/switch/split 2023-07-12 18:31:13,092 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/switch/merge 2023-07-12 18:31:13,108 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/snapshot-cleanup 2023-07-12 18:31:13,114 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/1/running 2023-07-12 18:31:13,114 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/1/running 2023-07-12 18:31:13,114 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/1/running 2023-07-12 18:31:13,114 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:13,116 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,40897,1689186671073, sessionid=0x1008273886f0000, setting cluster-up flag (Was=false) 2023-07-12 18:31:13,132 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:13,136 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /1/flush-table-proc/acquired, /1/flush-table-proc/reached, /1/flush-table-proc/abort 2023-07-12 18:31:13,137 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,40897,1689186671073 2023-07-12 18:31:13,147 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:13,151 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /1/online-snapshot/acquired, /1/online-snapshot/reached, /1/online-snapshot/abort 2023-07-12 18:31:13,152 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,40897,1689186671073 2023-07-12 18:31:13,155 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.hbase-snapshot/.tmp 2023-07-12 18:31:13,182 INFO [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(951): ClusterId : 23c3b538-bf67-481b-8351-f0e7ae087693 2023-07-12 18:31:13,182 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(951): ClusterId : 23c3b538-bf67-481b-8351-f0e7ae087693 2023-07-12 18:31:13,188 DEBUG [RS:1;jenkins-hbase20:37271] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:31:13,188 DEBUG [RS:0;jenkins-hbase20:40805] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:31:13,194 DEBUG [RS:0;jenkins-hbase20:40805] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:31:13,194 DEBUG [RS:1;jenkins-hbase20:37271] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:31:13,195 DEBUG [RS:0;jenkins-hbase20:40805] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:31:13,195 DEBUG [RS:1;jenkins-hbase20:37271] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:31:13,198 DEBUG [RS:0;jenkins-hbase20:40805] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:31:13,198 DEBUG [RS:1;jenkins-hbase20:37271] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:31:13,199 DEBUG [RS:0;jenkins-hbase20:40805] zookeeper.ReadOnlyZKClient(139): Connect 0x3410e7e7 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:13,200 DEBUG [RS:1;jenkins-hbase20:37271] zookeeper.ReadOnlyZKClient(139): Connect 0x32c50248 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:13,206 DEBUG [RS:0;jenkins-hbase20:40805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ad71f15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:13,207 DEBUG [RS:1;jenkins-hbase20:37271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c02fa60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:13,207 DEBUG [RS:1;jenkins-hbase20:37271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@383d6938, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:13,207 DEBUG [RS:0;jenkins-hbase20:40805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ee88c97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:13,227 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:37271 2023-07-12 18:31:13,231 INFO [RS:1;jenkins-hbase20:37271] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:31:13,231 INFO [RS:1;jenkins-hbase20:37271] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:31:13,231 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:31:13,232 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:40805 2023-07-12 18:31:13,233 INFO [RS:0;jenkins-hbase20:40805] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:31:13,233 INFO [RS:0;jenkins-hbase20:40805] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:31:13,233 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:31:13,235 INFO [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,40897,1689186671073 with isa=jenkins-hbase20.apache.org/148.251.75.209:40805, startcode=1689186672112 2023-07-12 18:31:13,235 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,40897,1689186671073 with isa=jenkins-hbase20.apache.org/148.251.75.209:37271, startcode=1689186672154 2023-07-12 18:31:13,252 DEBUG [RS:0;jenkins-hbase20:40805] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:31:13,252 DEBUG [RS:1;jenkins-hbase20:37271] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:31:13,294 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 18:31:13,304 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:13,304 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:13,305 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:13,305 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:13,305 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-07-12 18:31:13,305 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,305 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:13,305 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,306 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40303, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:31:13,306 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57435, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:31:13,308 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689186703308 2023-07-12 18:31:13,310 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 18:31:13,316 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 18:31:13,316 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 18:31:13,317 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40897] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 18:31:13,321 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:13,323 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 18:31:13,327 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40897] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 18:31:13,331 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 18:31:13,332 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 18:31:13,332 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 18:31:13,332 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 18:31:13,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 18:31:13,336 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 18:31:13,336 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 18:31:13,338 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 18:31:13,338 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 18:31:13,341 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186673341,5,FailOnTimeoutGroup] 2023-07-12 18:31:13,341 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186673341,5,FailOnTimeoutGroup] 2023-07-12 18:31:13,341 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,341 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 18:31:13,343 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,344 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,353 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 18:31:13,353 WARN [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 18:31:13,355 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 18:31:13,355 WARN [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 18:31:13,362 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 18:31:13,363 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 18:31:13,364 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347 2023-07-12 18:31:13,383 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:13,386 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 18:31:13,389 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/info 2023-07-12 18:31:13,390 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 18:31:13,392 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:13,392 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 18:31:13,395 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:13,396 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 18:31:13,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:13,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 18:31:13,399 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/table 2023-07-12 18:31:13,400 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 18:31:13,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:13,402 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740 2023-07-12 18:31:13,403 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740 2023-07-12 18:31:13,407 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 18:31:13,409 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 18:31:13,413 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:31:13,414 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63198350, jitterRate=-0.058271199464797974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 18:31:13,414 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 18:31:13,415 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 18:31:13,415 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 18:31:13,415 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 18:31:13,415 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 18:31:13,415 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 18:31:13,416 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 18:31:13,416 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 18:31:13,421 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 18:31:13,421 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 18:31:13,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 18:31:13,441 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 18:31:13,443 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 18:31:13,454 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,40897,1689186671073 with isa=jenkins-hbase20.apache.org/148.251.75.209:37271, startcode=1689186672154 2023-07-12 18:31:13,457 INFO [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,40897,1689186671073 with isa=jenkins-hbase20.apache.org/148.251.75.209:40805, startcode=1689186672112 2023-07-12 18:31:13,460 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40897] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:13,465 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40897] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:13,466 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347 2023-07-12 18:31:13,466 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:33763 2023-07-12 18:31:13,467 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347 2023-07-12 18:31:13,467 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:31:13,467 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:33763 2023-07-12 18:31:13,467 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:31:13,471 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/rs 2023-07-12 18:31:13,472 DEBUG [RS:1;jenkins-hbase20:37271] zookeeper.ZKUtil(162): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/rs/jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:13,472 DEBUG [RS:0;jenkins-hbase20:40805] zookeeper.ZKUtil(162): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/rs/jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:13,472 WARN [RS:1;jenkins-hbase20:37271] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:13,472 WARN [RS:0;jenkins-hbase20:40805] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:13,473 INFO [RS:1;jenkins-hbase20:37271] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:13,474 INFO [RS:0;jenkins-hbase20:40805] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:13,474 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:13,474 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:13,476 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,40805,1689186672112] 2023-07-12 18:31:13,476 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,37271,1689186672154] 2023-07-12 18:31:13,484 DEBUG [RS:0;jenkins-hbase20:40805] zookeeper.ZKUtil(162): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/rs/jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:13,484 DEBUG [RS:1;jenkins-hbase20:37271] zookeeper.ZKUtil(162): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/rs/jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:13,484 DEBUG [RS:0;jenkins-hbase20:40805] zookeeper.ZKUtil(162): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/rs/jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:13,485 DEBUG [RS:1;jenkins-hbase20:37271] zookeeper.ZKUtil(162): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/rs/jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:13,494 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.Replication(139): Replication stats-in-log period=5 seconds 2023-07-12 18:31:13,494 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.Replication(139): Replication stats-in-log period=5 seconds 2023-07-12 18:31:13,502 INFO [RS:1;jenkins-hbase20:37271] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:31:13,502 INFO [RS:0;jenkins-hbase20:40805] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:31:13,523 INFO [RS:1;jenkins-hbase20:37271] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:31:13,523 INFO [RS:0;jenkins-hbase20:40805] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:31:13,528 INFO [RS:0;jenkins-hbase20:40805] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:31:13,528 INFO [RS:1;jenkins-hbase20:37271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:31:13,528 INFO [RS:0;jenkins-hbase20:40805] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,528 INFO [RS:1;jenkins-hbase20:37271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,529 INFO [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:31:13,533 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:31:13,541 INFO [RS:1;jenkins-hbase20:37271] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,541 INFO [RS:0;jenkins-hbase20:40805] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,541 DEBUG [RS:1;jenkins-hbase20:37271] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,541 DEBUG [RS:0;jenkins-hbase20:40805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,542 DEBUG [RS:1;jenkins-hbase20:37271] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,542 DEBUG [RS:0;jenkins-hbase20:40805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,542 DEBUG [RS:1;jenkins-hbase20:37271] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,542 DEBUG [RS:0;jenkins-hbase20:40805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,542 DEBUG [RS:1;jenkins-hbase20:37271] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,542 DEBUG [RS:0;jenkins-hbase20:40805] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,542 DEBUG [RS:1;jenkins-hbase20:37271] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,542 DEBUG [RS:0;jenkins-hbase20:40805] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,542 DEBUG [RS:1;jenkins-hbase20:37271] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:13,543 DEBUG [RS:0;jenkins-hbase20:40805] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:13,543 DEBUG [RS:1;jenkins-hbase20:37271] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,543 DEBUG [RS:0;jenkins-hbase20:40805] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,543 DEBUG [RS:1;jenkins-hbase20:37271] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,543 DEBUG [RS:0;jenkins-hbase20:40805] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,543 DEBUG [RS:1;jenkins-hbase20:37271] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,543 DEBUG [RS:0;jenkins-hbase20:40805] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,543 DEBUG [RS:1;jenkins-hbase20:37271] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,543 DEBUG [RS:0;jenkins-hbase20:40805] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:13,548 INFO [RS:0;jenkins-hbase20:40805] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,548 INFO [RS:0;jenkins-hbase20:40805] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,548 INFO [RS:1;jenkins-hbase20:37271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,548 INFO [RS:0;jenkins-hbase20:40805] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,548 INFO [RS:1;jenkins-hbase20:37271] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,549 INFO [RS:1;jenkins-hbase20:37271] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,563 INFO [RS:1;jenkins-hbase20:37271] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:31:13,563 INFO [RS:0;jenkins-hbase20:40805] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:31:13,566 INFO [RS:1;jenkins-hbase20:37271] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37271,1689186672154-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,566 INFO [RS:0;jenkins-hbase20:40805] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40805,1689186672112-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:13,584 INFO [RS:1;jenkins-hbase20:37271] regionserver.Replication(203): jenkins-hbase20.apache.org,37271,1689186672154 started 2023-07-12 18:31:13,584 INFO [RS:0;jenkins-hbase20:40805] regionserver.Replication(203): jenkins-hbase20.apache.org,40805,1689186672112 started 2023-07-12 18:31:13,584 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,37271,1689186672154, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:37271, sessionid=0x1008273886f0002 2023-07-12 18:31:13,584 INFO [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,40805,1689186672112, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:40805, sessionid=0x1008273886f0001 2023-07-12 18:31:13,584 DEBUG [RS:1;jenkins-hbase20:37271] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:31:13,584 DEBUG [RS:0;jenkins-hbase20:40805] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:31:13,584 DEBUG [RS:1;jenkins-hbase20:37271] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:13,584 DEBUG [RS:0;jenkins-hbase20:40805] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:13,585 DEBUG [RS:1;jenkins-hbase20:37271] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37271,1689186672154' 2023-07-12 18:31:13,585 DEBUG [RS:0;jenkins-hbase20:40805] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,40805,1689186672112' 2023-07-12 18:31:13,586 DEBUG [RS:1;jenkins-hbase20:37271] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/1/flush-table-proc/abort' 2023-07-12 18:31:13,586 DEBUG [RS:0;jenkins-hbase20:40805] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/1/flush-table-proc/abort' 2023-07-12 18:31:13,586 DEBUG [RS:0;jenkins-hbase20:40805] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/1/flush-table-proc/acquired' 2023-07-12 18:31:13,586 DEBUG [RS:1;jenkins-hbase20:37271] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/1/flush-table-proc/acquired' 2023-07-12 18:31:13,587 DEBUG [RS:0;jenkins-hbase20:40805] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:31:13,587 DEBUG [RS:1;jenkins-hbase20:37271] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:31:13,587 DEBUG [RS:0;jenkins-hbase20:40805] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:31:13,587 DEBUG [RS:1;jenkins-hbase20:37271] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:31:13,587 DEBUG [RS:0;jenkins-hbase20:40805] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:13,587 DEBUG [RS:1;jenkins-hbase20:37271] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:13,588 DEBUG [RS:0;jenkins-hbase20:40805] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,40805,1689186672112' 2023-07-12 18:31:13,588 DEBUG [RS:0;jenkins-hbase20:40805] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/1/online-snapshot/abort' 2023-07-12 18:31:13,588 DEBUG [RS:1;jenkins-hbase20:37271] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37271,1689186672154' 2023-07-12 18:31:13,588 DEBUG [RS:1;jenkins-hbase20:37271] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/1/online-snapshot/abort' 2023-07-12 18:31:13,588 DEBUG [RS:0;jenkins-hbase20:40805] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/1/online-snapshot/acquired' 2023-07-12 18:31:13,588 DEBUG [RS:1;jenkins-hbase20:37271] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/1/online-snapshot/acquired' 2023-07-12 18:31:13,589 DEBUG [RS:0;jenkins-hbase20:40805] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:31:13,589 DEBUG [RS:1;jenkins-hbase20:37271] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:31:13,589 INFO [RS:0;jenkins-hbase20:40805] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:31:13,589 INFO [RS:1;jenkins-hbase20:37271] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:31:13,590 INFO [RS:0;jenkins-hbase20:40805] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:31:13,590 INFO [RS:1;jenkins-hbase20:37271] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:31:13,595 DEBUG [jenkins-hbase20:40897] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-07-12 18:31:13,599 DEBUG [jenkins-hbase20:40897] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:31:13,605 DEBUG [jenkins-hbase20:40897] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:31:13,605 DEBUG [jenkins-hbase20:40897] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:31:13,605 DEBUG [jenkins-hbase20:40897] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:31:13,608 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,37271,1689186672154, state=OPENING 2023-07-12 18:31:13,617 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 18:31:13,618 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:13,618 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /1/meta-region-server: CHANGED 2023-07-12 18:31:13,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,37271,1689186672154}] 2023-07-12 18:31:13,704 INFO [RS:0;jenkins-hbase20:40805] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40805%2C1689186672112, suffix=, logDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112, archiveDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs, maxLogs=10 2023-07-12 18:31:13,704 INFO [RS:1;jenkins-hbase20:37271] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37271%2C1689186672154, suffix=, logDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154, archiveDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs, maxLogs=10 2023-07-12 18:31:13,727 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK] 2023-07-12 18:31:13,727 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK] 2023-07-12 18:31:13,727 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK] 2023-07-12 18:31:13,728 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK] 2023-07-12 18:31:13,734 INFO [RS:1;jenkins-hbase20:37271] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154/jenkins-hbase20.apache.org%2C37271%2C1689186672154.1689186673708 2023-07-12 18:31:13,735 INFO [RS:0;jenkins-hbase20:40805] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708 2023-07-12 18:31:13,735 DEBUG [RS:1;jenkins-hbase20:37271] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK], DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK]] 2023-07-12 18:31:13,736 DEBUG [RS:0;jenkins-hbase20:40805] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK], DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK]] 2023-07-12 18:31:13,807 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:13,809 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:13,812 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:31:13,825 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 18:31:13,825 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:13,829 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37271%2C1689186672154.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154, archiveDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs, maxLogs=10 2023-07-12 18:31:13,851 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK] 2023-07-12 18:31:13,858 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK] 2023-07-12 18:31:13,869 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154/jenkins-hbase20.apache.org%2C37271%2C1689186672154.meta.1689186673831.meta 2023-07-12 18:31:13,870 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK], DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK]] 2023-07-12 18:31:13,870 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:13,872 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 18:31:13,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 18:31:13,927 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 18:31:13,931 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 18:31:13,932 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:13,932 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 18:31:13,932 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 18:31:13,935 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 18:31:13,937 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/info 2023-07-12 18:31:13,937 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/info 2023-07-12 18:31:13,938 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 18:31:13,939 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:13,939 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 18:31:13,941 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:13,941 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:13,942 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 18:31:13,943 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:13,943 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 18:31:13,945 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/table 2023-07-12 18:31:13,945 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/table 2023-07-12 18:31:13,945 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 18:31:13,946 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:13,948 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740 2023-07-12 18:31:13,952 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740 2023-07-12 18:31:13,955 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 18:31:13,958 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 18:31:13,960 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73171877, jitterRate=0.09034593403339386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 18:31:13,960 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 18:31:13,972 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689186673800 2023-07-12 18:31:13,990 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 18:31:13,991 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 18:31:13,992 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,37271,1689186672154, state=OPEN 2023-07-12 18:31:13,995 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/1/meta-region-server 2023-07-12 18:31:13,995 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /1/meta-region-server: CHANGED 2023-07-12 18:31:13,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 18:31:13,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,37271,1689186672154 in 371 msec 2023-07-12 18:31:14,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 18:31:14,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 572 msec 2023-07-12 18:31:14,009 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 791 msec 2023-07-12 18:31:14,009 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689186674009, completionTime=-1 2023-07-12 18:31:14,010 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-07-12 18:31:14,010 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 18:31:14,074 DEBUG [hconnection-0x6189f5f2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:14,078 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:14,101 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=2 2023-07-12 18:31:14,102 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689186734101 2023-07-12 18:31:14,102 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689186794102 2023-07-12 18:31:14,102 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 91 msec 2023-07-12 18:31:14,133 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40897,1689186671073-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:14,133 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40897,1689186671073-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:14,134 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40897,1689186671073-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:14,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:40897, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:14,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:14,142 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 18:31:14,153 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 18:31:14,154 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:14,165 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 18:31:14,169 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:31:14,172 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:31:14,210 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:14,214 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9 empty. 2023-07-12 18:31:14,215 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:14,215 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 18:31:14,258 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 18:31:14,260 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 340cf179e3faa54372c069aa2490aad9, NAME => 'hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp 2023-07-12 18:31:14,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:14,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 340cf179e3faa54372c069aa2490aad9, disabling compactions & flushes 2023-07-12 18:31:14,305 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:14,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:14,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. after waiting 0 ms 2023-07-12 18:31:14,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:14,306 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:14,306 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 340cf179e3faa54372c069aa2490aad9: 2023-07-12 18:31:14,311 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:31:14,326 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186674314"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689186674314"}]},"ts":"1689186674314"} 2023-07-12 18:31:14,355 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 18:31:14,357 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:31:14,363 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186674357"}]},"ts":"1689186674357"} 2023-07-12 18:31:14,369 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 18:31:14,373 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:31:14,375 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:31:14,375 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:31:14,375 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:31:14,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=340cf179e3faa54372c069aa2490aad9, ASSIGN}] 2023-07-12 18:31:14,383 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=340cf179e3faa54372c069aa2490aad9, ASSIGN 2023-07-12 18:31:14,385 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=340cf179e3faa54372c069aa2490aad9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37271,1689186672154; forceNewPlan=false, retain=false 2023-07-12 18:31:14,537 INFO [jenkins-hbase20:40897] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:31:14,538 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=340cf179e3faa54372c069aa2490aad9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:14,538 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186674538"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186674538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186674538"}]},"ts":"1689186674538"} 2023-07-12 18:31:14,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 340cf179e3faa54372c069aa2490aad9, server=jenkins-hbase20.apache.org,37271,1689186672154}] 2023-07-12 18:31:14,704 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:14,706 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 340cf179e3faa54372c069aa2490aad9, NAME => 'hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:14,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:14,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:14,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:14,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:14,711 INFO [StoreOpener-340cf179e3faa54372c069aa2490aad9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:14,713 DEBUG [StoreOpener-340cf179e3faa54372c069aa2490aad9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/info 2023-07-12 18:31:14,713 DEBUG [StoreOpener-340cf179e3faa54372c069aa2490aad9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/info 2023-07-12 18:31:14,714 INFO [StoreOpener-340cf179e3faa54372c069aa2490aad9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 340cf179e3faa54372c069aa2490aad9 columnFamilyName info 2023-07-12 18:31:14,715 INFO [StoreOpener-340cf179e3faa54372c069aa2490aad9-1] regionserver.HStore(310): Store=340cf179e3faa54372c069aa2490aad9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:14,719 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:14,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:14,726 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:14,735 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:31:14,737 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 340cf179e3faa54372c069aa2490aad9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68026069, jitterRate=0.01366741955280304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:31:14,737 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 340cf179e3faa54372c069aa2490aad9: 2023-07-12 18:31:14,741 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9., pid=6, masterSystemTime=1689186674698 2023-07-12 18:31:14,746 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:14,746 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:14,748 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=340cf179e3faa54372c069aa2490aad9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:14,748 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186674747"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186674747"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186674747"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186674747"}]},"ts":"1689186674747"} 2023-07-12 18:31:14,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 18:31:14,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 340cf179e3faa54372c069aa2490aad9, server=jenkins-hbase20.apache.org,37271,1689186672154 in 209 msec 2023-07-12 18:31:14,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 18:31:14,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=340cf179e3faa54372c069aa2490aad9, ASSIGN in 377 msec 2023-07-12 18:31:14,762 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:31:14,763 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186674762"}]},"ts":"1689186674762"} 2023-07-12 18:31:14,766 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 18:31:14,770 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/namespace 2023-07-12 18:31:14,770 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:31:14,771 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/1/namespace 2023-07-12 18:31:14,771 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:14,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 614 msec 2023-07-12 18:31:14,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 18:31:14,839 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/namespace 2023-07-12 18:31:14,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 42 msec 2023-07-12 18:31:14,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 18:31:14,871 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/namespace 2023-07-12 18:31:14,877 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 23 msec 2023-07-12 18:31:14,895 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/1/namespace/default 2023-07-12 18:31:14,896 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/1/namespace/hbase 2023-07-12 18:31:14,898 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.679sec 2023-07-12 18:31:14,902 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 18:31:14,904 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 18:31:14,905 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 18:31:14,906 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40897,1689186671073-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 18:31:14,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40897,1689186671073-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 18:31:14,920 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 18:31:14,992 DEBUG [Listener at localhost.localdomain/38071] zookeeper.ReadOnlyZKClient(139): Connect 0x4324ec28 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:14,997 DEBUG [Listener at localhost.localdomain/38071] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4669baf8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:15,014 DEBUG [hconnection-0x7c41fc10-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:15,029 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:15,040 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,40897,1689186671073 2023-07-12 18:31:15,040 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=4, rsPorts=, rsClass=null, numDataNodes=4, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 18:31:15,040 INFO [Listener at localhost.localdomain/38071] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/cluster_716fc7b6-48f9-c77a-dc76-2ce80ff5ed2b, deleteOnExit=true 2023-07-12 18:31:15,040 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 18:31:15,049 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/test.cache.data in system properties and HBase conf 2023-07-12 18:31:15,050 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 18:31:15,050 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/hadoop.log.dir in system properties and HBase conf 2023-07-12 18:31:15,050 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 18:31:15,050 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 18:31:15,050 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 18:31:15,050 DEBUG [Listener at localhost.localdomain/38071] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 18:31:15,051 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:31:15,051 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:31:15,051 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 18:31:15,051 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:31:15,051 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 18:31:15,051 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 18:31:15,051 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:31:15,051 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:31:15,052 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 18:31:15,052 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/nfs.dump.dir in system properties and HBase conf 2023-07-12 18:31:15,052 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/java.io.tmpdir in system properties and HBase conf 2023-07-12 18:31:15,052 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:31:15,052 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 18:31:15,052 INFO [Listener at localhost.localdomain/38071] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 18:31:15,079 WARN [Listener at localhost.localdomain/38071] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 18:31:15,080 WARN [Listener at localhost.localdomain/38071] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 18:31:15,119 WARN [Listener at localhost.localdomain/38071] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:31:15,121 INFO [Listener at localhost.localdomain/38071] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:31:15,127 INFO [Listener at localhost.localdomain/38071] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/java.io.tmpdir/Jetty_localhost_localdomain_41435_hdfs____.gp6gj1/webapp 2023-07-12 18:31:15,218 INFO [Listener at localhost.localdomain/38071] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:41435 2023-07-12 18:31:15,222 WARN [Listener at localhost.localdomain/38071] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 18:31:15,222 WARN [Listener at localhost.localdomain/38071] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 18:31:15,278 WARN [Listener at localhost.localdomain/41891] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:31:15,307 WARN [Listener at localhost.localdomain/41891] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:31:15,312 WARN [Listener at localhost.localdomain/41891] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:31:15,314 INFO [Listener at localhost.localdomain/41891] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:31:15,326 INFO [Listener at localhost.localdomain/41891] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/java.io.tmpdir/Jetty_localhost_37209_datanode____8vnl1a/webapp 2023-07-12 18:31:15,399 INFO [Listener at localhost.localdomain/41891] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37209 2023-07-12 18:31:15,411 WARN [Listener at localhost.localdomain/44725] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:31:15,433 WARN [Listener at localhost.localdomain/44725] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:31:15,437 WARN [Listener at localhost.localdomain/44725] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:31:15,438 INFO [Listener at localhost.localdomain/44725] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:31:15,444 INFO [Listener at localhost.localdomain/44725] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/java.io.tmpdir/Jetty_localhost_35851_datanode____ub6p09/webapp 2023-07-12 18:31:15,526 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2b726bfabfdc03b8: Processing first storage report for DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b from datanode 7a793e7a-1f31-48dc-800a-27610c677e09 2023-07-12 18:31:15,527 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2b726bfabfdc03b8: from storage DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b node DatanodeRegistration(127.0.0.1:38743, datanodeUuid=7a793e7a-1f31-48dc-800a-27610c677e09, infoPort=42853, infoSecurePort=0, ipcPort=44725, storageInfo=lv=-57;cid=testClusterID;nsid=1062233046;c=1689186675089), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 18:31:15,527 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2b726bfabfdc03b8: Processing first storage report for DS-09d31f95-82cd-41af-a835-8cd9e641adb9 from datanode 7a793e7a-1f31-48dc-800a-27610c677e09 2023-07-12 18:31:15,527 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2b726bfabfdc03b8: from storage DS-09d31f95-82cd-41af-a835-8cd9e641adb9 node DatanodeRegistration(127.0.0.1:38743, datanodeUuid=7a793e7a-1f31-48dc-800a-27610c677e09, infoPort=42853, infoSecurePort=0, ipcPort=44725, storageInfo=lv=-57;cid=testClusterID;nsid=1062233046;c=1689186675089), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:31:15,572 INFO [Listener at localhost.localdomain/44725] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35851 2023-07-12 18:31:15,586 WARN [Listener at localhost.localdomain/43093] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:31:15,613 WARN [Listener at localhost.localdomain/43093] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:31:15,617 WARN [Listener at localhost.localdomain/43093] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:31:15,618 INFO [Listener at localhost.localdomain/43093] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:31:15,622 INFO [Listener at localhost.localdomain/43093] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/java.io.tmpdir/Jetty_localhost_33237_datanode____r9vbml/webapp 2023-07-12 18:31:15,689 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xabedd7c1616abaf8: Processing first storage report for DS-46e2b732-ffcf-4808-935e-a4b02799b3ad from datanode c57c604e-bbe7-41ba-9589-9140b155f881 2023-07-12 18:31:15,689 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xabedd7c1616abaf8: from storage DS-46e2b732-ffcf-4808-935e-a4b02799b3ad node DatanodeRegistration(127.0.0.1:38461, datanodeUuid=c57c604e-bbe7-41ba-9589-9140b155f881, infoPort=44241, infoSecurePort=0, ipcPort=43093, storageInfo=lv=-57;cid=testClusterID;nsid=1062233046;c=1689186675089), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:31:15,689 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xabedd7c1616abaf8: Processing first storage report for DS-670170ae-730f-4e18-8814-1f8c08e044a5 from datanode c57c604e-bbe7-41ba-9589-9140b155f881 2023-07-12 18:31:15,689 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xabedd7c1616abaf8: from storage DS-670170ae-730f-4e18-8814-1f8c08e044a5 node DatanodeRegistration(127.0.0.1:38461, datanodeUuid=c57c604e-bbe7-41ba-9589-9140b155f881, infoPort=44241, infoSecurePort=0, ipcPort=43093, storageInfo=lv=-57;cid=testClusterID;nsid=1062233046;c=1689186675089), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:31:15,715 INFO [Listener at localhost.localdomain/43093] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33237 2023-07-12 18:31:15,725 WARN [Listener at localhost.localdomain/35887] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:31:15,746 WARN [Listener at localhost.localdomain/35887] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:31:15,749 WARN [Listener at localhost.localdomain/35887] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:31:15,750 INFO [Listener at localhost.localdomain/35887] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:31:15,756 INFO [Listener at localhost.localdomain/35887] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/java.io.tmpdir/Jetty_localhost_33655_datanode____.m2qzab/webapp 2023-07-12 18:31:15,822 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3e3a62a16874ee30: Processing first storage report for DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5 from datanode 66359283-3779-4c6b-a692-aa44efb0e3ae 2023-07-12 18:31:15,822 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3e3a62a16874ee30: from storage DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5 node DatanodeRegistration(127.0.0.1:45547, datanodeUuid=66359283-3779-4c6b-a692-aa44efb0e3ae, infoPort=44051, infoSecurePort=0, ipcPort=35887, storageInfo=lv=-57;cid=testClusterID;nsid=1062233046;c=1689186675089), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:31:15,822 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3e3a62a16874ee30: Processing first storage report for DS-11c2bde9-55fe-44cf-b73e-42496f5b4565 from datanode 66359283-3779-4c6b-a692-aa44efb0e3ae 2023-07-12 18:31:15,822 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3e3a62a16874ee30: from storage DS-11c2bde9-55fe-44cf-b73e-42496f5b4565 node DatanodeRegistration(127.0.0.1:45547, datanodeUuid=66359283-3779-4c6b-a692-aa44efb0e3ae, infoPort=44051, infoSecurePort=0, ipcPort=35887, storageInfo=lv=-57;cid=testClusterID;nsid=1062233046;c=1689186675089), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:31:15,859 INFO [Listener at localhost.localdomain/35887] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33655 2023-07-12 18:31:15,869 WARN [Listener at localhost.localdomain/40201] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:31:15,975 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc137aa120687b074: Processing first storage report for DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3 from datanode b88a26a9-93ac-4ef6-9992-0b46ee166647 2023-07-12 18:31:15,975 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc137aa120687b074: from storage DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3 node DatanodeRegistration(127.0.0.1:34087, datanodeUuid=b88a26a9-93ac-4ef6-9992-0b46ee166647, infoPort=41177, infoSecurePort=0, ipcPort=40201, storageInfo=lv=-57;cid=testClusterID;nsid=1062233046;c=1689186675089), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:31:15,975 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc137aa120687b074: Processing first storage report for DS-bb6e9824-2e41-46ce-b5e1-d82d240c6411 from datanode b88a26a9-93ac-4ef6-9992-0b46ee166647 2023-07-12 18:31:15,975 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc137aa120687b074: from storage DS-bb6e9824-2e41-46ce-b5e1-d82d240c6411 node DatanodeRegistration(127.0.0.1:34087, datanodeUuid=b88a26a9-93ac-4ef6-9992-0b46ee166647, infoPort=41177, infoSecurePort=0, ipcPort=40201, storageInfo=lv=-57;cid=testClusterID;nsid=1062233046;c=1689186675089), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:31:15,980 DEBUG [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b 2023-07-12 18:31:15,980 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:15,981 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,017 INFO [Listener at localhost.localdomain/40201] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27 with version=8 2023-07-12 18:31:16,017 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/hbase-staging 2023-07-12 18:31:16,019 INFO [Listener at localhost.localdomain/40201] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=18 2023-07-12 18:31:16,019 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,020 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,020 INFO [Listener at localhost.localdomain/40201] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:16,020 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,020 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:16,020 INFO [Listener at localhost.localdomain/40201] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:16,022 INFO [Listener at localhost.localdomain/40201] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41741 2023-07-12 18:31:16,023 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,024 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,025 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41741 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:16,028 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:417410x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:16,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41741-0x1008273886f0007 connected 2023-07-12 18:31:16,037 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:31:16,038 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:16,038 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/acl 2023-07-12 18:31:16,041 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41741 2023-07-12 18:31:16,042 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41741 2023-07-12 18:31:16,042 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41741 2023-07-12 18:31:16,042 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41741 2023-07-12 18:31:16,046 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41741 2023-07-12 18:31:16,046 INFO [Listener at localhost.localdomain/40201] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27, hbase.cluster.distributed=false 2023-07-12 18:31:16,059 INFO [Listener at localhost.localdomain/40201] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=18 2023-07-12 18:31:16,059 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,060 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,060 INFO [Listener at localhost.localdomain/40201] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:16,060 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,060 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:16,060 INFO [Listener at localhost.localdomain/40201] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:16,063 INFO [Listener at localhost.localdomain/40201] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34681 2023-07-12 18:31:16,063 INFO [Listener at localhost.localdomain/40201] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:31:16,065 DEBUG [Listener at localhost.localdomain/40201] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:31:16,066 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,067 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,068 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34681 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:16,073 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:346810x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:16,075 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:346810x0, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:31:16,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34681-0x1008273886f0008 connected 2023-07-12 18:31:16,076 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:16,077 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/acl 2023-07-12 18:31:16,077 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34681 2023-07-12 18:31:16,077 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34681 2023-07-12 18:31:16,078 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34681 2023-07-12 18:31:16,083 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34681 2023-07-12 18:31:16,084 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34681 2023-07-12 18:31:16,093 INFO [Listener at localhost.localdomain/40201] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=18 2023-07-12 18:31:16,094 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,094 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,094 INFO [Listener at localhost.localdomain/40201] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:16,094 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,094 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:16,094 INFO [Listener at localhost.localdomain/40201] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:16,097 INFO [Listener at localhost.localdomain/40201] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42439 2023-07-12 18:31:16,097 INFO [Listener at localhost.localdomain/40201] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:31:16,098 DEBUG [Listener at localhost.localdomain/40201] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:31:16,099 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,100 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,102 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42439 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:16,105 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:424390x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:16,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42439-0x1008273886f0009 connected 2023-07-12 18:31:16,107 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:31:16,108 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:16,109 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/acl 2023-07-12 18:31:16,111 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42439 2023-07-12 18:31:16,111 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42439 2023-07-12 18:31:16,112 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42439 2023-07-12 18:31:16,113 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42439 2023-07-12 18:31:16,113 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42439 2023-07-12 18:31:16,123 INFO [Listener at localhost.localdomain/40201] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=18 2023-07-12 18:31:16,123 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,123 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,123 INFO [Listener at localhost.localdomain/40201] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:16,123 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,123 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:16,124 INFO [Listener at localhost.localdomain/40201] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:16,128 INFO [Listener at localhost.localdomain/40201] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41549 2023-07-12 18:31:16,128 INFO [Listener at localhost.localdomain/40201] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:31:16,130 DEBUG [Listener at localhost.localdomain/40201] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:31:16,131 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,132 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,133 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41549 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:16,136 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:415490x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:16,138 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:415490x0, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:31:16,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41549-0x1008273886f000a connected 2023-07-12 18:31:16,139 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:16,140 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/acl 2023-07-12 18:31:16,142 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41549 2023-07-12 18:31:16,143 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41549 2023-07-12 18:31:16,146 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41549 2023-07-12 18:31:16,147 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41549 2023-07-12 18:31:16,147 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41549 2023-07-12 18:31:16,157 INFO [Listener at localhost.localdomain/40201] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=18 2023-07-12 18:31:16,157 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,157 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,157 INFO [Listener at localhost.localdomain/40201] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:16,158 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:16,158 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:16,158 INFO [Listener at localhost.localdomain/40201] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:16,160 INFO [Listener at localhost.localdomain/40201] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34413 2023-07-12 18:31:16,160 INFO [Listener at localhost.localdomain/40201] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:31:16,162 DEBUG [Listener at localhost.localdomain/40201] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:31:16,162 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,163 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,165 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34413 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:16,169 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:344130x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:16,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34413-0x1008273886f000b connected 2023-07-12 18:31:16,172 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:31:16,173 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:16,173 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/acl 2023-07-12 18:31:16,174 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34413 2023-07-12 18:31:16,175 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34413 2023-07-12 18:31:16,175 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34413 2023-07-12 18:31:16,178 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34413 2023-07-12 18:31:16,179 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34413 2023-07-12 18:31:16,181 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /2/backup-masters/jenkins-hbase20.apache.org,41741,1689186676019 2023-07-12 18:31:16,183 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/backup-masters 2023-07-12 18:31:16,183 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/backup-masters/jenkins-hbase20.apache.org,41741,1689186676019 2023-07-12 18:31:16,185 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/master 2023-07-12 18:31:16,185 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/master 2023-07-12 18:31:16,185 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/master 2023-07-12 18:31:16,185 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/master 2023-07-12 18:31:16,187 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:16,185 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/master 2023-07-12 18:31:16,189 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/master 2023-07-12 18:31:16,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/master 2023-07-12 18:31:16,191 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /2/backup-masters/jenkins-hbase20.apache.org,41741,1689186676019 from backup master directory 2023-07-12 18:31:16,197 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/backup-masters/jenkins-hbase20.apache.org,41741,1689186676019 2023-07-12 18:31:16,197 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:16,197 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/backup-masters 2023-07-12 18:31:16,197 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,41741,1689186676019 2023-07-12 18:31:16,233 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/hbase.id with ID: 3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:16,253 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:16,256 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:16,290 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7127d88c to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:16,295 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21c0fe02, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:16,296 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:16,296 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 18:31:16,296 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:16,299 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store-tmp 2023-07-12 18:31:16,322 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:16,322 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 18:31:16,322 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:16,322 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:16,322 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 18:31:16,322 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:16,322 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:16,322 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:31:16,324 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41741,1689186676019 2023-07-12 18:31:16,328 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41741%2C1689186676019, suffix=, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41741,1689186676019, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/oldWALs, maxLogs=10 2023-07-12 18:31:16,345 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK] 2023-07-12 18:31:16,347 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK] 2023-07-12 18:31:16,348 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK] 2023-07-12 18:31:16,353 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41741,1689186676019/jenkins-hbase20.apache.org%2C41741%2C1689186676019.1689186676328 2023-07-12 18:31:16,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK], DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK], DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK]] 2023-07-12 18:31:16,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:16,354 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:16,354 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:16,354 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:16,357 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:16,360 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 18:31:16,360 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 18:31:16,361 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:16,363 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:16,365 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:16,369 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:16,375 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:31:16,376 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61603947, jitterRate=-0.08202965557575226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:31:16,376 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:31:16,377 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 18:31:16,378 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 18:31:16,378 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 18:31:16,378 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 18:31:16,379 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 18:31:16,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 1 msec 2023-07-12 18:31:16,381 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 18:31:16,382 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 18:31:16,383 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 18:31:16,392 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 18:31:16,392 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 18:31:16,393 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/balancer 2023-07-12 18:31:16,393 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 18:31:16,393 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/normalizer 2023-07-12 18:31:16,395 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:16,397 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/switch/split 2023-07-12 18:31:16,397 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/switch/merge 2023-07-12 18:31:16,398 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/snapshot-cleanup 2023-07-12 18:31:16,399 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/running 2023-07-12 18:31:16,399 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/running 2023-07-12 18:31:16,399 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/running 2023-07-12 18:31:16,399 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:16,399 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/running 2023-07-12 18:31:16,399 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/running 2023-07-12 18:31:16,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,41741,1689186676019, sessionid=0x1008273886f0007, setting cluster-up flag (Was=false) 2023-07-12 18:31:16,405 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:16,409 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /2/flush-table-proc/acquired, /2/flush-table-proc/reached, /2/flush-table-proc/abort 2023-07-12 18:31:16,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41741,1689186676019 2023-07-12 18:31:16,413 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:16,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /2/online-snapshot/acquired, /2/online-snapshot/reached, /2/online-snapshot/abort 2023-07-12 18:31:16,419 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41741,1689186676019 2023-07-12 18:31:16,420 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.hbase-snapshot/.tmp 2023-07-12 18:31:16,423 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 18:31:16,423 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:16,423 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:16,423 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:16,424 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:16,424 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-07-12 18:31:16,424 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,424 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:16,424 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,429 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689186706429 2023-07-12 18:31:16,430 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 18:31:16,430 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 18:31:16,430 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 18:31:16,430 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 18:31:16,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 18:31:16,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 18:31:16,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,433 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 18:31:16,433 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 18:31:16,433 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 18:31:16,433 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 18:31:16,433 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 18:31:16,433 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 18:31:16,433 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 18:31:16,434 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186676433,5,FailOnTimeoutGroup] 2023-07-12 18:31:16,434 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186676434,5,FailOnTimeoutGroup] 2023-07-12 18:31:16,434 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,435 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 18:31:16,435 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,435 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,435 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:16,468 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 18:31:16,468 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 18:31:16,469 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27 2023-07-12 18:31:16,484 INFO [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(951): ClusterId : 3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:16,485 INFO [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(951): ClusterId : 3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:16,484 INFO [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(951): ClusterId : 3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:16,484 INFO [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(951): ClusterId : 3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:16,489 DEBUG [RS:2;jenkins-hbase20:41549] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:31:16,487 DEBUG [RS:3;jenkins-hbase20:34413] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:31:16,486 DEBUG [RS:1;jenkins-hbase20:42439] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:31:16,490 DEBUG [RS:0;jenkins-hbase20:34681] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:31:16,494 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:16,494 DEBUG [RS:1;jenkins-hbase20:42439] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:31:16,494 DEBUG [RS:2;jenkins-hbase20:41549] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:31:16,494 DEBUG [RS:1;jenkins-hbase20:42439] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:31:16,494 DEBUG [RS:2;jenkins-hbase20:41549] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:31:16,495 DEBUG [RS:3;jenkins-hbase20:34413] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:31:16,495 DEBUG [RS:3;jenkins-hbase20:34413] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:31:16,496 DEBUG [RS:0;jenkins-hbase20:34681] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:31:16,496 DEBUG [RS:0;jenkins-hbase20:34681] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:31:16,497 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 18:31:16,497 DEBUG [RS:1;jenkins-hbase20:42439] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:31:16,497 DEBUG [RS:2;jenkins-hbase20:41549] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:31:16,500 DEBUG [RS:0;jenkins-hbase20:34681] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:31:16,502 DEBUG [RS:2;jenkins-hbase20:41549] zookeeper.ReadOnlyZKClient(139): Connect 0x25f569ac to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:16,502 DEBUG [RS:3;jenkins-hbase20:34413] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:31:16,502 DEBUG [RS:1;jenkins-hbase20:42439] zookeeper.ReadOnlyZKClient(139): Connect 0x69f2c45a to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:16,502 DEBUG [RS:0;jenkins-hbase20:34681] zookeeper.ReadOnlyZKClient(139): Connect 0x55e54aa2 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:16,504 DEBUG [RS:3;jenkins-hbase20:34413] zookeeper.ReadOnlyZKClient(139): Connect 0x767c4057 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:16,508 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info 2023-07-12 18:31:16,509 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 18:31:16,509 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:16,510 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 18:31:16,522 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:16,522 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 18:31:16,522 DEBUG [RS:1;jenkins-hbase20:42439] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67352714, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:16,524 DEBUG [RS:3;jenkins-hbase20:34413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78bbb0e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:16,526 DEBUG [RS:1;jenkins-hbase20:42439] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@630aaf2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:16,527 DEBUG [RS:0;jenkins-hbase20:34681] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14d84099, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:16,527 DEBUG [RS:3;jenkins-hbase20:34413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3986bad3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:16,527 DEBUG [RS:0;jenkins-hbase20:34681] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a4902ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:16,528 DEBUG [RS:2;jenkins-hbase20:41549] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f0d02dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:16,528 DEBUG [RS:2;jenkins-hbase20:41549] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a0f9959, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:16,529 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:16,529 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 18:31:16,532 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/table 2023-07-12 18:31:16,533 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 18:31:16,534 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:16,536 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740 2023-07-12 18:31:16,538 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740 2023-07-12 18:31:16,540 DEBUG [RS:3;jenkins-hbase20:34413] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:3;jenkins-hbase20:34413 2023-07-12 18:31:16,540 INFO [RS:3;jenkins-hbase20:34413] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:31:16,540 INFO [RS:3;jenkins-hbase20:34413] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:31:16,541 DEBUG [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:31:16,541 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:42439 2023-07-12 18:31:16,541 INFO [RS:1;jenkins-hbase20:42439] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:31:16,541 INFO [RS:1;jenkins-hbase20:42439] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:31:16,541 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:31:16,541 DEBUG [RS:0;jenkins-hbase20:34681] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:34681 2023-07-12 18:31:16,541 INFO [RS:0;jenkins-hbase20:34681] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:31:16,541 INFO [RS:0;jenkins-hbase20:34681] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:31:16,541 DEBUG [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:31:16,542 INFO [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,41741,1689186676019 with isa=jenkins-hbase20.apache.org/148.251.75.209:34413, startcode=1689186676157 2023-07-12 18:31:16,542 INFO [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,41741,1689186676019 with isa=jenkins-hbase20.apache.org/148.251.75.209:34681, startcode=1689186676059 2023-07-12 18:31:16,542 INFO [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,41741,1689186676019 with isa=jenkins-hbase20.apache.org/148.251.75.209:42439, startcode=1689186676093 2023-07-12 18:31:16,542 DEBUG [RS:3;jenkins-hbase20:34413] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:31:16,542 DEBUG [RS:0;jenkins-hbase20:34681] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:31:16,542 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 18:31:16,542 DEBUG [RS:1;jenkins-hbase20:42439] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:31:16,548 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46365, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:31:16,549 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 18:31:16,549 DEBUG [RS:2;jenkins-hbase20:41549] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:41549 2023-07-12 18:31:16,550 INFO [RS:2;jenkins-hbase20:41549] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:31:16,550 INFO [RS:2;jenkins-hbase20:41549] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:31:16,550 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60867, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:31:16,551 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41741] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:16,550 DEBUG [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:31:16,552 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41741] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:16,550 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44113, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:31:16,552 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27 2023-07-12 18:31:16,552 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:41891 2023-07-12 18:31:16,552 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:31:16,553 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41741] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:16,553 DEBUG [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27 2023-07-12 18:31:16,553 DEBUG [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:41891 2023-07-12 18:31:16,553 DEBUG [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:31:16,555 INFO [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,41741,1689186676019 with isa=jenkins-hbase20.apache.org/148.251.75.209:41549, startcode=1689186676122 2023-07-12 18:31:16,555 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:16,555 DEBUG [RS:2;jenkins-hbase20:41549] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:31:16,556 DEBUG [RS:1;jenkins-hbase20:42439] zookeeper.ZKUtil(162): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:16,556 WARN [RS:1;jenkins-hbase20:42439] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:16,556 INFO [RS:1;jenkins-hbase20:42439] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:16,556 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:16,559 DEBUG [RS:0;jenkins-hbase20:34681] zookeeper.ZKUtil(162): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:16,559 WARN [RS:0;jenkins-hbase20:34681] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:16,559 INFO [RS:0;jenkins-hbase20:34681] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:16,559 DEBUG [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:16,562 DEBUG [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27 2023-07-12 18:31:16,562 DEBUG [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:41891 2023-07-12 18:31:16,563 DEBUG [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:31:16,565 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:31:16,566 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71959792, jitterRate=0.07228446006774902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 18:31:16,568 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 18:31:16,568 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 18:31:16,569 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56363, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:31:16,569 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 18:31:16,570 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 18:31:16,570 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41741] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:16,570 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 18:31:16,570 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 18:31:16,572 DEBUG [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27 2023-07-12 18:31:16,572 DEBUG [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:41891 2023-07-12 18:31:16,572 DEBUG [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:31:16,572 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,42439,1689186676093] 2023-07-12 18:31:16,573 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34681,1689186676059] 2023-07-12 18:31:16,573 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34413,1689186676157] 2023-07-12 18:31:16,573 DEBUG [RS:3;jenkins-hbase20:34413] zookeeper.ZKUtil(162): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:16,573 WARN [RS:3;jenkins-hbase20:34413] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:16,573 INFO [RS:3;jenkins-hbase20:34413] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:16,573 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:16,573 DEBUG [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:16,574 DEBUG [RS:2;jenkins-hbase20:41549] zookeeper.ZKUtil(162): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:16,574 WARN [RS:2;jenkins-hbase20:41549] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:16,574 INFO [RS:2;jenkins-hbase20:41549] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:16,574 DEBUG [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:16,576 DEBUG [RS:0;jenkins-hbase20:34681] zookeeper.ZKUtil(162): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:16,576 DEBUG [RS:0;jenkins-hbase20:34681] zookeeper.ZKUtil(162): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:16,577 DEBUG [RS:0;jenkins-hbase20:34681] zookeeper.ZKUtil(162): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:16,577 DEBUG [RS:0;jenkins-hbase20:34681] zookeeper.ZKUtil(162): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:16,581 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 18:31:16,581 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 18:31:16,581 DEBUG [RS:0;jenkins-hbase20:34681] regionserver.Replication(139): Replication stats-in-log period=5 seconds 2023-07-12 18:31:16,581 INFO [RS:0;jenkins-hbase20:34681] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:31:16,583 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 18:31:16,583 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 18:31:16,583 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 18:31:16,585 DEBUG [RS:1;jenkins-hbase20:42439] zookeeper.ZKUtil(162): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:16,586 DEBUG [RS:1;jenkins-hbase20:42439] zookeeper.ZKUtil(162): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:16,591 INFO [RS:0;jenkins-hbase20:34681] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:31:16,591 DEBUG [RS:1;jenkins-hbase20:42439] zookeeper.ZKUtil(162): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:16,592 DEBUG [RS:1;jenkins-hbase20:42439] zookeeper.ZKUtil(162): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:16,593 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.Replication(139): Replication stats-in-log period=5 seconds 2023-07-12 18:31:16,593 INFO [RS:1;jenkins-hbase20:42439] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:31:16,597 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,41549,1689186676122] 2023-07-12 18:31:16,602 INFO [RS:0;jenkins-hbase20:34681] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:31:16,602 INFO [RS:0;jenkins-hbase20:34681] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,604 INFO [RS:1;jenkins-hbase20:42439] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:31:16,602 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 18:31:16,606 INFO [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:31:16,613 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 18:31:16,613 INFO [RS:1;jenkins-hbase20:42439] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:31:16,613 INFO [RS:1;jenkins-hbase20:42439] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,613 INFO [RS:0;jenkins-hbase20:34681] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,614 INFO [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:31:16,614 DEBUG [RS:0;jenkins-hbase20:34681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,614 DEBUG [RS:0;jenkins-hbase20:34681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,614 DEBUG [RS:0;jenkins-hbase20:34681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,614 DEBUG [RS:0;jenkins-hbase20:34681] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,614 DEBUG [RS:0;jenkins-hbase20:34681] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,614 DEBUG [RS:0;jenkins-hbase20:34681] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:16,616 DEBUG [RS:0;jenkins-hbase20:34681] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,616 DEBUG [RS:0;jenkins-hbase20:34681] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,616 DEBUG [RS:0;jenkins-hbase20:34681] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,616 DEBUG [RS:0;jenkins-hbase20:34681] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,626 INFO [RS:1;jenkins-hbase20:42439] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,626 INFO [RS:0;jenkins-hbase20:34681] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,626 DEBUG [RS:1;jenkins-hbase20:42439] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,626 INFO [RS:0;jenkins-hbase20:34681] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,627 DEBUG [RS:1;jenkins-hbase20:42439] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,627 DEBUG [RS:2;jenkins-hbase20:41549] zookeeper.ZKUtil(162): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:16,627 INFO [RS:0;jenkins-hbase20:34681] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,627 DEBUG [RS:1;jenkins-hbase20:42439] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,627 DEBUG [RS:3;jenkins-hbase20:34413] zookeeper.ZKUtil(162): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:16,627 DEBUG [RS:1;jenkins-hbase20:42439] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,627 DEBUG [RS:1;jenkins-hbase20:42439] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,627 DEBUG [RS:2;jenkins-hbase20:41549] zookeeper.ZKUtil(162): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:16,627 DEBUG [RS:1;jenkins-hbase20:42439] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:16,628 DEBUG [RS:1;jenkins-hbase20:42439] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,628 DEBUG [RS:2;jenkins-hbase20:41549] zookeeper.ZKUtil(162): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:16,627 DEBUG [RS:3;jenkins-hbase20:34413] zookeeper.ZKUtil(162): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:16,628 DEBUG [RS:1;jenkins-hbase20:42439] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,628 DEBUG [RS:1;jenkins-hbase20:42439] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,628 DEBUG [RS:2;jenkins-hbase20:41549] zookeeper.ZKUtil(162): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:16,628 DEBUG [RS:1;jenkins-hbase20:42439] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,628 DEBUG [RS:3;jenkins-hbase20:34413] zookeeper.ZKUtil(162): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:16,629 DEBUG [RS:3;jenkins-hbase20:34413] zookeeper.ZKUtil(162): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:16,629 DEBUG [RS:2;jenkins-hbase20:41549] regionserver.Replication(139): Replication stats-in-log period=5 seconds 2023-07-12 18:31:16,630 INFO [RS:2;jenkins-hbase20:41549] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:31:16,630 DEBUG [RS:3;jenkins-hbase20:34413] regionserver.Replication(139): Replication stats-in-log period=5 seconds 2023-07-12 18:31:16,632 INFO [RS:3;jenkins-hbase20:34413] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:31:16,647 INFO [RS:3;jenkins-hbase20:34413] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:31:16,652 INFO [RS:2;jenkins-hbase20:41549] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:31:16,652 INFO [RS:1;jenkins-hbase20:42439] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,652 INFO [RS:3;jenkins-hbase20:34413] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:31:16,652 INFO [RS:1;jenkins-hbase20:42439] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,652 INFO [RS:3;jenkins-hbase20:34413] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,652 INFO [RS:2;jenkins-hbase20:41549] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:31:16,652 INFO [RS:1;jenkins-hbase20:42439] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,652 INFO [RS:2;jenkins-hbase20:41549] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,653 INFO [RS:0;jenkins-hbase20:34681] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:31:16,653 INFO [RS:0;jenkins-hbase20:34681] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34681,1689186676059-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,653 INFO [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:31:16,653 INFO [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:31:16,655 INFO [RS:3;jenkins-hbase20:34413] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,656 INFO [RS:2;jenkins-hbase20:41549] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,656 DEBUG [RS:3;jenkins-hbase20:34413] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,656 DEBUG [RS:2;jenkins-hbase20:41549] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,656 DEBUG [RS:3;jenkins-hbase20:34413] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,656 DEBUG [RS:2;jenkins-hbase20:41549] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,656 DEBUG [RS:3;jenkins-hbase20:34413] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,656 DEBUG [RS:2;jenkins-hbase20:41549] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,656 DEBUG [RS:3;jenkins-hbase20:34413] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,656 DEBUG [RS:2;jenkins-hbase20:41549] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,656 DEBUG [RS:3;jenkins-hbase20:34413] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,656 DEBUG [RS:2;jenkins-hbase20:41549] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,656 DEBUG [RS:3;jenkins-hbase20:34413] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:16,656 DEBUG [RS:2;jenkins-hbase20:41549] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:16,656 DEBUG [RS:3;jenkins-hbase20:34413] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,656 DEBUG [RS:2;jenkins-hbase20:41549] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,657 DEBUG [RS:3;jenkins-hbase20:34413] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,657 DEBUG [RS:2;jenkins-hbase20:41549] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,657 DEBUG [RS:3;jenkins-hbase20:34413] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,657 DEBUG [RS:2;jenkins-hbase20:41549] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,657 DEBUG [RS:3;jenkins-hbase20:34413] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,657 DEBUG [RS:2;jenkins-hbase20:41549] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:16,661 INFO [RS:2;jenkins-hbase20:41549] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,661 INFO [RS:3;jenkins-hbase20:34413] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,661 INFO [RS:2;jenkins-hbase20:41549] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,661 INFO [RS:3;jenkins-hbase20:34413] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,661 INFO [RS:2;jenkins-hbase20:41549] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,661 INFO [RS:3;jenkins-hbase20:34413] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,671 INFO [RS:2;jenkins-hbase20:41549] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:31:16,671 INFO [RS:2;jenkins-hbase20:41549] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41549,1689186676122-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,672 INFO [RS:1;jenkins-hbase20:42439] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:31:16,672 INFO [RS:0;jenkins-hbase20:34681] regionserver.Replication(203): jenkins-hbase20.apache.org,34681,1689186676059 started 2023-07-12 18:31:16,672 INFO [RS:1;jenkins-hbase20:42439] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42439,1689186676093-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,672 INFO [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,34681,1689186676059, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34681, sessionid=0x1008273886f0008 2023-07-12 18:31:16,672 DEBUG [RS:0;jenkins-hbase20:34681] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:31:16,672 DEBUG [RS:0;jenkins-hbase20:34681] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:16,672 DEBUG [RS:0;jenkins-hbase20:34681] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34681,1689186676059' 2023-07-12 18:31:16,672 DEBUG [RS:0;jenkins-hbase20:34681] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/flush-table-proc/abort' 2023-07-12 18:31:16,673 INFO [RS:3;jenkins-hbase20:34413] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:31:16,673 INFO [RS:3;jenkins-hbase20:34413] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34413,1689186676157-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:16,673 DEBUG [RS:0;jenkins-hbase20:34681] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/flush-table-proc/acquired' 2023-07-12 18:31:16,696 DEBUG [RS:0;jenkins-hbase20:34681] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:31:16,696 DEBUG [RS:0;jenkins-hbase20:34681] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:31:16,696 DEBUG [RS:0;jenkins-hbase20:34681] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:16,696 DEBUG [RS:0;jenkins-hbase20:34681] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34681,1689186676059' 2023-07-12 18:31:16,696 DEBUG [RS:0;jenkins-hbase20:34681] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/online-snapshot/abort' 2023-07-12 18:31:16,697 DEBUG [RS:0;jenkins-hbase20:34681] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/online-snapshot/acquired' 2023-07-12 18:31:16,697 DEBUG [RS:0;jenkins-hbase20:34681] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:31:16,697 INFO [RS:0;jenkins-hbase20:34681] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:31:16,697 INFO [RS:0;jenkins-hbase20:34681] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:31:16,700 INFO [RS:2;jenkins-hbase20:41549] regionserver.Replication(203): jenkins-hbase20.apache.org,41549,1689186676122 started 2023-07-12 18:31:16,701 INFO [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,41549,1689186676122, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:41549, sessionid=0x1008273886f000a 2023-07-12 18:31:16,701 DEBUG [RS:2;jenkins-hbase20:41549] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:31:16,701 DEBUG [RS:2;jenkins-hbase20:41549] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:16,701 DEBUG [RS:2;jenkins-hbase20:41549] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41549,1689186676122' 2023-07-12 18:31:16,701 DEBUG [RS:2;jenkins-hbase20:41549] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/flush-table-proc/abort' 2023-07-12 18:31:16,701 DEBUG [RS:2;jenkins-hbase20:41549] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/flush-table-proc/acquired' 2023-07-12 18:31:16,702 DEBUG [RS:2;jenkins-hbase20:41549] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:31:16,702 DEBUG [RS:2;jenkins-hbase20:41549] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:31:16,702 DEBUG [RS:2;jenkins-hbase20:41549] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:16,702 DEBUG [RS:2;jenkins-hbase20:41549] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41549,1689186676122' 2023-07-12 18:31:16,702 DEBUG [RS:2;jenkins-hbase20:41549] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/online-snapshot/abort' 2023-07-12 18:31:16,702 DEBUG [RS:2;jenkins-hbase20:41549] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/online-snapshot/acquired' 2023-07-12 18:31:16,702 DEBUG [RS:2;jenkins-hbase20:41549] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:31:16,702 INFO [RS:2;jenkins-hbase20:41549] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:31:16,702 INFO [RS:2;jenkins-hbase20:41549] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:31:16,715 INFO [RS:1;jenkins-hbase20:42439] regionserver.Replication(203): jenkins-hbase20.apache.org,42439,1689186676093 started 2023-07-12 18:31:16,715 INFO [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,42439,1689186676093, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:42439, sessionid=0x1008273886f0009 2023-07-12 18:31:16,718 INFO [RS:3;jenkins-hbase20:34413] regionserver.Replication(203): jenkins-hbase20.apache.org,34413,1689186676157 started 2023-07-12 18:31:16,718 INFO [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,34413,1689186676157, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34413, sessionid=0x1008273886f000b 2023-07-12 18:31:16,718 DEBUG [RS:1;jenkins-hbase20:42439] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:31:16,718 DEBUG [RS:3;jenkins-hbase20:34413] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:31:16,718 DEBUG [RS:1;jenkins-hbase20:42439] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:16,719 DEBUG [RS:1;jenkins-hbase20:42439] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42439,1689186676093' 2023-07-12 18:31:16,719 DEBUG [RS:3;jenkins-hbase20:34413] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:16,719 DEBUG [RS:1;jenkins-hbase20:42439] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/flush-table-proc/abort' 2023-07-12 18:31:16,719 DEBUG [RS:3;jenkins-hbase20:34413] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34413,1689186676157' 2023-07-12 18:31:16,719 DEBUG [RS:3;jenkins-hbase20:34413] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/flush-table-proc/abort' 2023-07-12 18:31:16,719 DEBUG [RS:1;jenkins-hbase20:42439] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/flush-table-proc/acquired' 2023-07-12 18:31:16,720 DEBUG [RS:1;jenkins-hbase20:42439] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:31:16,720 DEBUG [RS:1;jenkins-hbase20:42439] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:31:16,720 DEBUG [RS:1;jenkins-hbase20:42439] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:16,720 DEBUG [RS:1;jenkins-hbase20:42439] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42439,1689186676093' 2023-07-12 18:31:16,720 DEBUG [RS:1;jenkins-hbase20:42439] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/online-snapshot/abort' 2023-07-12 18:31:16,721 DEBUG [RS:1;jenkins-hbase20:42439] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/online-snapshot/acquired' 2023-07-12 18:31:16,721 DEBUG [RS:1;jenkins-hbase20:42439] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:31:16,721 INFO [RS:1;jenkins-hbase20:42439] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:31:16,721 INFO [RS:1;jenkins-hbase20:42439] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:31:16,722 DEBUG [RS:3;jenkins-hbase20:34413] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/flush-table-proc/acquired' 2023-07-12 18:31:16,727 DEBUG [RS:3;jenkins-hbase20:34413] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:31:16,727 DEBUG [RS:3;jenkins-hbase20:34413] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:31:16,727 DEBUG [RS:3;jenkins-hbase20:34413] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:16,727 DEBUG [RS:3;jenkins-hbase20:34413] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34413,1689186676157' 2023-07-12 18:31:16,727 DEBUG [RS:3;jenkins-hbase20:34413] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/online-snapshot/abort' 2023-07-12 18:31:16,728 DEBUG [RS:3;jenkins-hbase20:34413] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/online-snapshot/acquired' 2023-07-12 18:31:16,728 DEBUG [RS:3;jenkins-hbase20:34413] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:31:16,728 INFO [RS:3;jenkins-hbase20:34413] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:31:16,729 INFO [RS:3;jenkins-hbase20:34413] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:31:16,764 DEBUG [jenkins-hbase20:41741] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=4, allServersCount=4 2023-07-12 18:31:16,764 DEBUG [jenkins-hbase20:41741] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:31:16,767 DEBUG [jenkins-hbase20:41741] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:31:16,767 DEBUG [jenkins-hbase20:41741] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:31:16,767 DEBUG [jenkins-hbase20:41741] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:31:16,767 DEBUG [jenkins-hbase20:41741] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 0 2023-07-12 18:31:16,767 DEBUG [jenkins-hbase20:41741] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:31:16,769 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,42439,1689186676093, state=OPENING 2023-07-12 18:31:16,770 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 18:31:16,771 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:16,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,42439,1689186676093}] 2023-07-12 18:31:16,772 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /2/meta-region-server: CHANGED 2023-07-12 18:31:16,800 INFO [RS:0;jenkins-hbase20:34681] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34681%2C1689186676059, suffix=, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34681,1689186676059, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs, maxLogs=10 2023-07-12 18:31:16,805 INFO [RS:2;jenkins-hbase20:41549] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41549%2C1689186676122, suffix=, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,41549,1689186676122, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs, maxLogs=10 2023-07-12 18:31:16,826 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK] 2023-07-12 18:31:16,827 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK] 2023-07-12 18:31:16,827 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK] 2023-07-12 18:31:16,831 INFO [RS:1;jenkins-hbase20:42439] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42439%2C1689186676093, suffix=, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,42439,1689186676093, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs, maxLogs=10 2023-07-12 18:31:16,833 INFO [RS:3;jenkins-hbase20:34413] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34413%2C1689186676157, suffix=, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34413,1689186676157, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs, maxLogs=10 2023-07-12 18:31:16,848 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK] 2023-07-12 18:31:16,848 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK] 2023-07-12 18:31:16,848 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK] 2023-07-12 18:31:16,849 INFO [RS:0;jenkins-hbase20:34681] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34681,1689186676059/jenkins-hbase20.apache.org%2C34681%2C1689186676059.1689186676802 2023-07-12 18:31:16,852 DEBUG [RS:0;jenkins-hbase20:34681] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK], DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK], DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK]] 2023-07-12 18:31:16,861 INFO [RS:2;jenkins-hbase20:41549] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,41549,1689186676122/jenkins-hbase20.apache.org%2C41549%2C1689186676122.1689186676806 2023-07-12 18:31:16,861 DEBUG [RS:2;jenkins-hbase20:41549] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK], DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK], DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK]] 2023-07-12 18:31:16,883 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK] 2023-07-12 18:31:16,883 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK] 2023-07-12 18:31:16,884 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK] 2023-07-12 18:31:16,887 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK] 2023-07-12 18:31:16,888 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK] 2023-07-12 18:31:16,899 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK] 2023-07-12 18:31:16,909 INFO [RS:1;jenkins-hbase20:42439] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,42439,1689186676093/jenkins-hbase20.apache.org%2C42439%2C1689186676093.1689186676832 2023-07-12 18:31:16,909 INFO [RS:3;jenkins-hbase20:34413] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34413,1689186676157/jenkins-hbase20.apache.org%2C34413%2C1689186676157.1689186676834 2023-07-12 18:31:16,910 DEBUG [RS:1;jenkins-hbase20:42439] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK], DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK], DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK]] 2023-07-12 18:31:16,911 DEBUG [RS:3;jenkins-hbase20:34413] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK], DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK], DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK]] 2023-07-12 18:31:16,928 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:16,928 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:16,937 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:31:16,947 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 18:31:16,948 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:16,951 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42439%2C1689186676093.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,42439,1689186676093, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs, maxLogs=10 2023-07-12 18:31:16,967 DEBUG [RS-EventLoopGroup-10-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK] 2023-07-12 18:31:16,967 DEBUG [RS-EventLoopGroup-10-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK] 2023-07-12 18:31:16,967 DEBUG [RS-EventLoopGroup-10-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK] 2023-07-12 18:31:16,983 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,42439,1689186676093/jenkins-hbase20.apache.org%2C42439%2C1689186676093.meta.1689186676951.meta 2023-07-12 18:31:16,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK], DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK], DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK]] 2023-07-12 18:31:16,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:16,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 18:31:16,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 18:31:16,989 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 18:31:16,989 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 18:31:16,989 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:16,989 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 18:31:16,990 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 18:31:16,992 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 18:31:16,993 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info 2023-07-12 18:31:16,993 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info 2023-07-12 18:31:16,993 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 18:31:16,994 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:16,994 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 18:31:16,996 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:16,996 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:16,996 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 18:31:16,997 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:16,997 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 18:31:16,999 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/table 2023-07-12 18:31:16,999 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/table 2023-07-12 18:31:16,999 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 18:31:17,000 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:17,002 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740 2023-07-12 18:31:17,006 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740 2023-07-12 18:31:17,010 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 18:31:17,012 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 18:31:17,013 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72623714, jitterRate=0.08217766880989075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 18:31:17,013 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 18:31:17,018 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689186676928 2023-07-12 18:31:17,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 18:31:17,026 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 18:31:17,027 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,42439,1689186676093, state=OPEN 2023-07-12 18:31:17,029 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/2/meta-region-server 2023-07-12 18:31:17,029 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /2/meta-region-server: CHANGED 2023-07-12 18:31:17,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 18:31:17,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,42439,1689186676093 in 258 msec 2023-07-12 18:31:17,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 18:31:17,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 450 msec 2023-07-12 18:31:17,040 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 617 msec 2023-07-12 18:31:17,040 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689186677040, completionTime=-1 2023-07-12 18:31:17,040 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=4; waited=0ms, expected min=4 server(s), max=4 server(s), master is running 2023-07-12 18:31:17,040 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 18:31:17,044 DEBUG [hconnection-0x4155257a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:17,046 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:17,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=4 2023-07-12 18:31:17,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689186737049 2023-07-12 18:31:17,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689186797049 2023-07-12 18:31:17,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 8 msec 2023-07-12 18:31:17,058 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41741,1689186676019-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:17,058 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41741,1689186676019-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:17,058 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41741,1689186676019-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:17,059 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:41741, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:17,059 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:17,059 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 18:31:17,059 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:17,061 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 18:31:17,061 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 18:31:17,064 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:31:17,065 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:31:17,072 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:17,073 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c empty. 2023-07-12 18:31:17,074 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:17,074 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 18:31:17,141 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 18:31:17,143 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 63272e89b8aafccb1ffb2f93ed48b12c, NAME => 'hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp 2023-07-12 18:31:17,167 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:17,167 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 63272e89b8aafccb1ffb2f93ed48b12c, disabling compactions & flushes 2023-07-12 18:31:17,167 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:17,167 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:17,167 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. after waiting 0 ms 2023-07-12 18:31:17,167 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:17,167 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:17,167 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 63272e89b8aafccb1ffb2f93ed48b12c: 2023-07-12 18:31:17,173 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:31:17,175 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186677175"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689186677175"}]},"ts":"1689186677175"} 2023-07-12 18:31:17,180 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 18:31:17,181 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:31:17,181 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186677181"}]},"ts":"1689186677181"} 2023-07-12 18:31:17,184 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 18:31:17,188 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:31:17,189 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:31:17,189 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:31:17,189 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:31:17,189 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 0 2023-07-12 18:31:17,189 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:31:17,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN}] 2023-07-12 18:31:17,193 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN 2023-07-12 18:31:17,195 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34413,1689186676157; forceNewPlan=false, retain=false 2023-07-12 18:31:17,346 INFO [jenkins-hbase20:41741] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:31:17,347 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=63272e89b8aafccb1ffb2f93ed48b12c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:17,347 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186677347"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186677347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186677347"}]},"ts":"1689186677347"} 2023-07-12 18:31:17,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 63272e89b8aafccb1ffb2f93ed48b12c, server=jenkins-hbase20.apache.org,34413,1689186676157}] 2023-07-12 18:31:17,505 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:17,505 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:17,506 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:31:17,513 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:17,513 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 63272e89b8aafccb1ffb2f93ed48b12c, NAME => 'hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:17,513 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:17,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:17,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:17,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:17,516 INFO [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:17,518 DEBUG [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/info 2023-07-12 18:31:17,519 DEBUG [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/info 2023-07-12 18:31:17,520 INFO [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63272e89b8aafccb1ffb2f93ed48b12c columnFamilyName info 2023-07-12 18:31:17,521 INFO [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] regionserver.HStore(310): Store=63272e89b8aafccb1ffb2f93ed48b12c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:17,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:17,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:17,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:17,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:31:17,534 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 63272e89b8aafccb1ffb2f93ed48b12c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63638611, jitterRate=-0.05171079933643341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:31:17,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 63272e89b8aafccb1ffb2f93ed48b12c: 2023-07-12 18:31:17,535 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c., pid=6, masterSystemTime=1689186677504 2023-07-12 18:31:17,542 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:17,543 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:17,544 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=63272e89b8aafccb1ffb2f93ed48b12c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:17,544 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186677543"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186677543"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186677543"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186677543"}]},"ts":"1689186677543"} 2023-07-12 18:31:17,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 18:31:17,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 63272e89b8aafccb1ffb2f93ed48b12c, server=jenkins-hbase20.apache.org,34413,1689186676157 in 196 msec 2023-07-12 18:31:17,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 18:31:17,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN in 361 msec 2023-07-12 18:31:17,556 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:31:17,556 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186677556"}]},"ts":"1689186677556"} 2023-07-12 18:31:17,559 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 18:31:17,562 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/namespace 2023-07-12 18:31:17,562 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:31:17,563 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/namespace 2023-07-12 18:31:17,563 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:17,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 503 msec 2023-07-12 18:31:17,566 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:17,568 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:17,572 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 18:31:17,596 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/namespace 2023-07-12 18:31:17,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-07-12 18:31:17,615 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 18:31:17,627 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/namespace 2023-07-12 18:31:17,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-12 18:31:17,640 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/2/namespace/default 2023-07-12 18:31:17,641 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/2/namespace/hbase 2023-07-12 18:31:17,642 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.444sec 2023-07-12 18:31:17,642 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 18:31:17,642 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 18:31:17,643 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 18:31:17,643 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41741,1689186676019-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 18:31:17,643 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41741,1689186676019-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 18:31:17,646 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 18:31:17,684 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(139): Connect 0x3c6d8e64 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:17,692 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bbfb47b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:17,694 DEBUG [hconnection-0x8df8cd7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:17,695 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:17,697 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,41741,1689186676019 2023-07-12 18:31:17,708 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 18:31:17,710 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 18:31:17,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 't1_syncup', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '1'}, {NAME => 'norep', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:17,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=t1_syncup 2023-07-12 18:31:17,728 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:31:17,731 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:31:17,734 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:17,735 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13 empty. 2023-07-12 18:31:17,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "t1_syncup" procId is: 9 2023-07-12 18:31:17,735 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:17,735 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived t1_syncup regions 2023-07-12 18:31:17,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:31:17,765 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/default/t1_syncup/.tabledesc/.tableinfo.0000000001 2023-07-12 18:31:17,766 INFO [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(7675): creating {ENCODED => 80b2b4fe906f78b38a7d69ad08dadb13, NAME => 't1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='t1_syncup', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '1'}, {NAME => 'norep', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp 2023-07-12 18:31:17,786 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(866): Instantiated t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:17,786 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1604): Closing 80b2b4fe906f78b38a7d69ad08dadb13, disabling compactions & flushes 2023-07-12 18:31:17,786 INFO [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1626): Closing region t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:17,786 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:17,786 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1714): Acquired close lock on t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. after waiting 0 ms 2023-07-12 18:31:17,786 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1724): Updates disabled for region t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:17,786 INFO [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1838): Closed t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:17,786 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1558): Region close journal for 80b2b4fe906f78b38a7d69ad08dadb13: 2023-07-12 18:31:17,791 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:31:17,793 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186677793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689186677793"}]},"ts":"1689186677793"} 2023-07-12 18:31:17,796 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 18:31:17,797 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:31:17,797 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t1_syncup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186677797"}]},"ts":"1689186677797"} 2023-07-12 18:31:17,800 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=t1_syncup, state=ENABLING in hbase:meta 2023-07-12 18:31:17,803 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:31:17,805 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:31:17,805 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:31:17,805 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:31:17,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1_syncup, region=80b2b4fe906f78b38a7d69ad08dadb13, ASSIGN}] 2023-07-12 18:31:17,808 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1_syncup, region=80b2b4fe906f78b38a7d69ad08dadb13, ASSIGN 2023-07-12 18:31:17,809 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=t1_syncup, region=80b2b4fe906f78b38a7d69ad08dadb13, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37271,1689186672154; forceNewPlan=false, retain=false 2023-07-12 18:31:17,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:31:17,960 INFO [jenkins-hbase20:40897] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:31:17,961 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=80b2b4fe906f78b38a7d69ad08dadb13, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:17,961 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186677961"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186677961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186677961"}]},"ts":"1689186677961"} 2023-07-12 18:31:17,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 80b2b4fe906f78b38a7d69ad08dadb13, server=jenkins-hbase20.apache.org,37271,1689186672154}] 2023-07-12 18:31:18,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:31:18,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:18,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80b2b4fe906f78b38a7d69ad08dadb13, NAME => 't1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:18,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table t1_syncup 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:18,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:18,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:18,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:18,127 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:18,130 DEBUG [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/cf1 2023-07-12 18:31:18,130 DEBUG [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/cf1 2023-07-12 18:31:18,130 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80b2b4fe906f78b38a7d69ad08dadb13 columnFamilyName cf1 2023-07-12 18:31:18,131 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] regionserver.HStore(310): Store=80b2b4fe906f78b38a7d69ad08dadb13/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:18,132 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family norep of region 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:18,133 DEBUG [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/norep 2023-07-12 18:31:18,134 DEBUG [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/norep 2023-07-12 18:31:18,134 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80b2b4fe906f78b38a7d69ad08dadb13 columnFamilyName norep 2023-07-12 18:31:18,135 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] regionserver.HStore(310): Store=80b2b4fe906f78b38a7d69ad08dadb13/norep, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:18,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:18,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:18,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table t1_syncup descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 18:31:18,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:18,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:31:18,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 80b2b4fe906f78b38a7d69ad08dadb13; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69584140, jitterRate=0.03688448667526245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 18:31:18,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 80b2b4fe906f78b38a7d69ad08dadb13: 2023-07-12 18:31:18,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13., pid=11, masterSystemTime=1689186678117 2023-07-12 18:31:18,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:18,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:18,152 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=80b2b4fe906f78b38a7d69ad08dadb13, regionState=OPEN, repBarrier=2, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:18,152 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":6,"row":"t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13.","families":{"rep_barrier":[],"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186678151"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186678151"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186678151"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186678151"}]},"ts":"1689186678151"} 2023-07-12 18:31:18,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 18:31:18,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 80b2b4fe906f78b38a7d69ad08dadb13, server=jenkins-hbase20.apache.org,37271,1689186672154 in 191 msec 2023-07-12 18:31:18,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 18:31:18,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=t1_syncup, region=80b2b4fe906f78b38a7d69ad08dadb13, ASSIGN in 353 msec 2023-07-12 18:31:18,163 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:31:18,163 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t1_syncup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186678163"}]},"ts":"1689186678163"} 2023-07-12 18:31:18,165 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=t1_syncup, state=ENABLED in hbase:meta 2023-07-12 18:31:18,167 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:31:18,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=t1_syncup in 446 msec 2023-07-12 18:31:18,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:31:18,357 INFO [Listener at localhost.localdomain/40201] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:t1_syncup, procId: 9 completed 2023-07-12 18:31:18,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 't2_syncup', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '1'}, {NAME => 'norep', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:18,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=t2_syncup 2023-07-12 18:31:18,364 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:31:18,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "t2_syncup" procId is: 12 2023-07-12 18:31:18,367 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:31:18,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:31:18,370 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:18,371 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18 empty. 2023-07-12 18:31:18,371 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:18,371 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived t2_syncup regions 2023-07-12 18:31:18,401 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp/data/default/t2_syncup/.tabledesc/.tableinfo.0000000001 2023-07-12 18:31:18,403 INFO [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(7675): creating {ENCODED => 93e6956722d05ec4972c3a5270b9ac18, NAME => 't2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='t2_syncup', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '1'}, {NAME => 'norep', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.tmp 2023-07-12 18:31:18,433 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(866): Instantiated t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:18,433 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1604): Closing 93e6956722d05ec4972c3a5270b9ac18, disabling compactions & flushes 2023-07-12 18:31:18,433 INFO [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1626): Closing region t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:18,433 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:18,433 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1714): Acquired close lock on t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. after waiting 0 ms 2023-07-12 18:31:18,433 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1724): Updates disabled for region t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:18,433 INFO [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1838): Closed t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:18,433 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1558): Region close journal for 93e6956722d05ec4972c3a5270b9ac18: 2023-07-12 18:31:18,439 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:31:18,442 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186678441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689186678441"}]},"ts":"1689186678441"} 2023-07-12 18:31:18,444 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 18:31:18,445 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:31:18,445 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t2_syncup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186678445"}]},"ts":"1689186678445"} 2023-07-12 18:31:18,447 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=t2_syncup, state=ENABLING in hbase:meta 2023-07-12 18:31:18,450 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:31:18,452 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:31:18,452 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:31:18,452 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:31:18,452 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t2_syncup, region=93e6956722d05ec4972c3a5270b9ac18, ASSIGN}] 2023-07-12 18:31:18,458 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t2_syncup, region=93e6956722d05ec4972c3a5270b9ac18, ASSIGN 2023-07-12 18:31:18,460 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=t2_syncup, region=93e6956722d05ec4972c3a5270b9ac18, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40805,1689186672112; forceNewPlan=false, retain=false 2023-07-12 18:31:18,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:31:18,583 INFO [jenkins-hbase20:37271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:18,583 INFO [jenkins-hbase20:40805Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:18,610 INFO [jenkins-hbase20:40897] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:31:18,612 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=93e6956722d05ec4972c3a5270b9ac18, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:18,612 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186678612"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186678612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186678612"}]},"ts":"1689186678612"} 2023-07-12 18:31:18,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 93e6956722d05ec4972c3a5270b9ac18, server=jenkins-hbase20.apache.org,40805,1689186672112}] 2023-07-12 18:31:18,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:31:18,769 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:18,770 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:18,772 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:31:18,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:18,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93e6956722d05ec4972c3a5270b9ac18, NAME => 't2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:18,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table t2_syncup 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:18,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:18,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:18,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:18,782 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:18,785 DEBUG [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/cf1 2023-07-12 18:31:18,786 DEBUG [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/cf1 2023-07-12 18:31:18,786 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93e6956722d05ec4972c3a5270b9ac18 columnFamilyName cf1 2023-07-12 18:31:18,787 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] regionserver.HStore(310): Store=93e6956722d05ec4972c3a5270b9ac18/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:18,787 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family norep of region 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:18,790 DEBUG [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/norep 2023-07-12 18:31:18,790 DEBUG [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/norep 2023-07-12 18:31:18,790 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93e6956722d05ec4972c3a5270b9ac18 columnFamilyName norep 2023-07-12 18:31:18,791 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] regionserver.HStore(310): Store=93e6956722d05ec4972c3a5270b9ac18/norep, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:18,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:18,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:18,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table t2_syncup descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 18:31:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:18,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:31:18,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 93e6956722d05ec4972c3a5270b9ac18; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71781672, jitterRate=0.06963026523590088}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 18:31:18,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 93e6956722d05ec4972c3a5270b9ac18: 2023-07-12 18:31:18,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18., pid=14, masterSystemTime=1689186678769 2023-07-12 18:31:18,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:18,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:18,823 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=93e6956722d05ec4972c3a5270b9ac18, regionState=OPEN, repBarrier=2, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:18,823 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":6,"row":"t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.","families":{"rep_barrier":[],"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186678823"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186678823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186678823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186678823"}]},"ts":"1689186678823"} 2023-07-12 18:31:18,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-12 18:31:18,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 93e6956722d05ec4972c3a5270b9ac18, server=jenkins-hbase20.apache.org,40805,1689186672112 in 211 msec 2023-07-12 18:31:18,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-12 18:31:18,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=t2_syncup, region=93e6956722d05ec4972c3a5270b9ac18, ASSIGN in 377 msec 2023-07-12 18:31:18,837 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:31:18,837 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t2_syncup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186678837"}]},"ts":"1689186678837"} 2023-07-12 18:31:18,840 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=t2_syncup, state=ENABLED in hbase:meta 2023-07-12 18:31:18,843 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:31:18,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=t2_syncup in 484 msec 2023-07-12 18:31:18,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:31:18,973 INFO [Listener at localhost.localdomain/40201] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:t2_syncup, procId: 12 completed 2023-07-12 18:31:18,980 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 18:31:18,982 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 18:31:18,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 't1_syncup', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'norep', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:18,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=t1_syncup 2023-07-12 18:31:18,993 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:31:18,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "t1_syncup" procId is: 9 2023-07-12 18:31:18,996 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:31:18,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:31:18,998 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:18,999 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902 empty. 2023-07-12 18:31:18,999 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:18,999 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived t1_syncup regions 2023-07-12 18:31:19,024 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/default/t1_syncup/.tabledesc/.tableinfo.0000000001 2023-07-12 18:31:19,026 INFO [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(7675): creating {ENCODED => e22f590dd8a98a0fba12251b93336902, NAME => 't1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='t1_syncup', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'norep', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp 2023-07-12 18:31:19,044 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(866): Instantiated t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:19,045 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1604): Closing e22f590dd8a98a0fba12251b93336902, disabling compactions & flushes 2023-07-12 18:31:19,045 INFO [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1626): Closing region t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:19,045 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:19,045 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1714): Acquired close lock on t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. after waiting 0 ms 2023-07-12 18:31:19,045 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1724): Updates disabled for region t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:19,045 INFO [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1838): Closed t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:19,045 DEBUG [RegionOpenAndInit-t1_syncup-pool-0] regionserver.HRegion(1558): Region close journal for e22f590dd8a98a0fba12251b93336902: 2023-07-12 18:31:19,051 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:31:19,053 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186679053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689186679053"}]},"ts":"1689186679053"} 2023-07-12 18:31:19,055 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 18:31:19,056 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:31:19,057 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t1_syncup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186679056"}]},"ts":"1689186679056"} 2023-07-12 18:31:19,059 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=t1_syncup, state=ENABLING in hbase:meta 2023-07-12 18:31:19,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:31:19,064 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:31:19,064 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:31:19,064 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:31:19,064 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 0 2023-07-12 18:31:19,064 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:31:19,065 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN}] 2023-07-12 18:31:19,068 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN 2023-07-12 18:31:19,069 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34681,1689186676059; forceNewPlan=false, retain=false 2023-07-12 18:31:19,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:31:19,220 INFO [jenkins-hbase20:41741] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:31:19,221 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e22f590dd8a98a0fba12251b93336902, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:19,221 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186679221"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186679221"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186679221"}]},"ts":"1689186679221"} 2023-07-12 18:31:19,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e22f590dd8a98a0fba12251b93336902, server=jenkins-hbase20.apache.org,34681,1689186676059}] 2023-07-12 18:31:19,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:31:19,378 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:19,379 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:19,381 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:31:19,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:19,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e22f590dd8a98a0fba12251b93336902, NAME => 't1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:19,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table t1_syncup e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:19,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:19,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:19,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:19,389 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:19,391 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1 2023-07-12 18:31:19,391 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1 2023-07-12 18:31:19,392 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e22f590dd8a98a0fba12251b93336902 columnFamilyName cf1 2023-07-12 18:31:19,393 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(310): Store=e22f590dd8a98a0fba12251b93336902/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:19,393 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family norep of region e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:19,395 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/norep 2023-07-12 18:31:19,395 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/norep 2023-07-12 18:31:19,396 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e22f590dd8a98a0fba12251b93336902 columnFamilyName norep 2023-07-12 18:31:19,396 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(310): Store=e22f590dd8a98a0fba12251b93336902/norep, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:19,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:19,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:19,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table t1_syncup descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 18:31:19,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:19,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:31:19,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e22f590dd8a98a0fba12251b93336902; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65422603, jitterRate=-0.025127246975898743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 18:31:19,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e22f590dd8a98a0fba12251b93336902: 2023-07-12 18:31:19,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902., pid=11, masterSystemTime=1689186679378 2023-07-12 18:31:19,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:19,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:19,424 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e22f590dd8a98a0fba12251b93336902, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:19,425 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186679424"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186679424"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186679424"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186679424"}]},"ts":"1689186679424"} 2023-07-12 18:31:19,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 18:31:19,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e22f590dd8a98a0fba12251b93336902, server=jenkins-hbase20.apache.org,34681,1689186676059 in 203 msec 2023-07-12 18:31:19,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 18:31:19,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN in 364 msec 2023-07-12 18:31:19,433 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:31:19,434 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t1_syncup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186679433"}]},"ts":"1689186679433"} 2023-07-12 18:31:19,436 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=t1_syncup, state=ENABLED in hbase:meta 2023-07-12 18:31:19,438 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=t1_syncup execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:31:19,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=t1_syncup in 453 msec 2023-07-12 18:31:19,464 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 18:31:19,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:31:19,601 INFO [Listener at localhost.localdomain/40201] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:t1_syncup, procId: 9 completed 2023-07-12 18:31:19,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 't2_syncup', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'norep', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:19,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=t2_syncup 2023-07-12 18:31:19,612 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:31:19,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "t2_syncup" procId is: 12 2023-07-12 18:31:19,614 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:31:19,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:31:19,619 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:19,623 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f empty. 2023-07-12 18:31:19,628 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:19,628 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived t2_syncup regions 2023-07-12 18:31:19,670 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp/data/default/t2_syncup/.tabledesc/.tableinfo.0000000001 2023-07-12 18:31:19,673 INFO [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(7675): creating {ENCODED => bde3b0e33054f5210b7a78be27604e3f, NAME => 't2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='t2_syncup', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'norep', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.tmp 2023-07-12 18:31:19,693 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 't2_syncup' 2023-07-12 18:31:19,695 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 18:31:19,696 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 18:31:19,697 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 't1_syncup' 2023-07-12 18:31:19,711 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(866): Instantiated t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:19,714 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1604): Closing bde3b0e33054f5210b7a78be27604e3f, disabling compactions & flushes 2023-07-12 18:31:19,714 INFO [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1626): Closing region t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:19,714 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:19,714 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1714): Acquired close lock on t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. after waiting 0 ms 2023-07-12 18:31:19,714 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1724): Updates disabled for region t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:19,714 INFO [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1838): Closed t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:19,714 DEBUG [RegionOpenAndInit-t2_syncup-pool-0] regionserver.HRegion(1558): Region close journal for bde3b0e33054f5210b7a78be27604e3f: 2023-07-12 18:31:19,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:31:19,718 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:31:19,719 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186679718"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689186679718"}]},"ts":"1689186679718"} 2023-07-12 18:31:19,721 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 18:31:19,722 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:31:19,722 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t2_syncup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186679722"}]},"ts":"1689186679722"} 2023-07-12 18:31:19,724 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=t2_syncup, state=ENABLING in hbase:meta 2023-07-12 18:31:19,728 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:31:19,729 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:31:19,729 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:31:19,729 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:31:19,729 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 0 2023-07-12 18:31:19,729 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:31:19,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN}] 2023-07-12 18:31:19,732 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN 2023-07-12 18:31:19,734 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41549,1689186676122; forceNewPlan=false, retain=false 2023-07-12 18:31:19,884 INFO [jenkins-hbase20:41741] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:31:19,886 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bde3b0e33054f5210b7a78be27604e3f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:19,886 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186679886"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186679886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186679886"}]},"ts":"1689186679886"} 2023-07-12 18:31:19,889 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure bde3b0e33054f5210b7a78be27604e3f, server=jenkins-hbase20.apache.org,41549,1689186676122}] 2023-07-12 18:31:19,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:31:20,045 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:20,045 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:20,046 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:31:20,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:20,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bde3b0e33054f5210b7a78be27604e3f, NAME => 't2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:20,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table t2_syncup bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:20,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:20,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:20,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:20,054 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:20,057 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1 2023-07-12 18:31:20,057 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1 2023-07-12 18:31:20,057 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bde3b0e33054f5210b7a78be27604e3f columnFamilyName cf1 2023-07-12 18:31:20,058 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(310): Store=bde3b0e33054f5210b7a78be27604e3f/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:20,059 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family norep of region bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:20,061 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/norep 2023-07-12 18:31:20,061 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/norep 2023-07-12 18:31:20,061 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bde3b0e33054f5210b7a78be27604e3f columnFamilyName norep 2023-07-12 18:31:20,063 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(310): Store=bde3b0e33054f5210b7a78be27604e3f/norep, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:20,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:20,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:20,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table t2_syncup descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 18:31:20,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:20,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:31:20,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bde3b0e33054f5210b7a78be27604e3f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69793683, jitterRate=0.04000692069530487}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 18:31:20,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bde3b0e33054f5210b7a78be27604e3f: 2023-07-12 18:31:20,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f., pid=14, masterSystemTime=1689186680044 2023-07-12 18:31:20,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:20,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:20,097 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bde3b0e33054f5210b7a78be27604e3f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:20,097 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186680097"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186680097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186680097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186680097"}]},"ts":"1689186680097"} 2023-07-12 18:31:20,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-12 18:31:20,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure bde3b0e33054f5210b7a78be27604e3f, server=jenkins-hbase20.apache.org,41549,1689186676122 in 212 msec 2023-07-12 18:31:20,109 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-12 18:31:20,109 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN in 376 msec 2023-07-12 18:31:20,110 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:31:20,111 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t2_syncup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689186680110"}]},"ts":"1689186680110"} 2023-07-12 18:31:20,112 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=t2_syncup, state=ENABLED in hbase:meta 2023-07-12 18:31:20,115 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=t2_syncup execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:31:20,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=t2_syncup in 509 msec 2023-07-12 18:31:20,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41741] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:31:20,220 INFO [Listener at localhost.localdomain/40201] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:t2_syncup, procId: 12 completed 2023-07-12 18:31:20,220 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(139): Connect 0x4769220c to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:20,227 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64147d50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:20,228 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(139): Connect 0x487b9788 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:20,248 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@468cb5c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:20,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.HMaster(3464): Client=jenkins//148.251.75.209 creating replication peer, id=1, config=clusterKey=127.0.0.1:64028:/2,replicationEndpointImpl=null,replicateAllUserTables=true,bandwidth=0,serial=false, state=ENABLED 2023-07-12 18:31:20,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:PRE_PEER_MODIFICATION; org.apache.hadoop.hbase.master.replication.AddPeerProcedure 2023-07-12 18:31:20,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-12 18:31:20,292 INFO [PEWorker-1] hbase.HBaseConfiguration(293): Overriding client registry implementation to org.apache.hadoop.hbase.client.ZKConnectionRegistry 2023-07-12 18:31:20,292 INFO [PEWorker-1] zookeeper.RecoverableZooKeeper(93): Process identifier=org.apache.hadoop.hbase.master.replication.ReplicationPeerManager@224bd2f3check-peer-cluster-id connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:20,297 DEBUG [PEWorker-1-EventThread] zookeeper.ZKWatcher(600): org.apache.hadoop.hbase.master.replication.ReplicationPeerManager@224bd2f3check-peer-cluster-id0x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:20,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): org.apache.hadoop.hbase.master.replication.ReplicationPeerManager@224bd2f3check-peer-cluster-id-0x1008273886f0014 connected 2023-07-12 18:31:20,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-12 18:31:20,401 DEBUG [PEWorker-1-EventThread] zookeeper.ZKWatcher(600): org.apache.hadoop.hbase.master.replication.ReplicationPeerManager@224bd2f3check-peer-cluster-id-0x1008273886f0014, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:20,408 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:20,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=17, ppid=15, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2023-07-12 18:31:20,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-12 18:31:20,603 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40805] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.RefreshPeerCallable, pid=17 2023-07-12 18:31:20,603 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37271] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.RefreshPeerCallable, pid=16 2023-07-12 18:31:20,604 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0] regionserver.RefreshPeerCallable(54): Received a peer change event, peerId=1, type=ADD_PEER 2023-07-12 18:31:20,604 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0] regionserver.RefreshPeerCallable(54): Received a peer change event, peerId=1, type=ADD_PEER 2023-07-12 18:31:20,615 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0] hbase.HBaseConfiguration(293): Overriding client registry implementation to org.apache.hadoop.hbase.client.ZKConnectionRegistry 2023-07-12 18:31:20,615 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0] hbase.HBaseConfiguration(293): Overriding client registry implementation to org.apache.hadoop.hbase.client.ZKConnectionRegistry 2023-07-12 18:31:20,632 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0] regionserver.ReplicationSource(232): queueId=1, ReplicationSource: 1, currentBandwidth=0 2023-07-12 18:31:20,632 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0] regionserver.ReplicationSource(232): queueId=1, ReplicationSource: 1, currentBandwidth=0 2023-07-12 18:31:20,647 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=17 2023-07-12 18:31:20,647 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=16 2023-07-12 18:31:20,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.HMaster(3641): Remote procedure done, pid=16 2023-07-12 18:31:20,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40897] master.HMaster(3641): Remote procedure done, pid=17 2023-07-12 18:31:20,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] replication.RefreshPeerProcedure(116): Refresh peer 1 for ADD on jenkins-hbase20.apache.org,37271,1689186672154 suceeded 2023-07-12 18:31:20,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40897] replication.RefreshPeerProcedure(116): Refresh peer 1 for ADD on jenkins-hbase20.apache.org,40805,1689186672112 suceeded 2023-07-12 18:31:20,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 220 msec 2023-07-12 18:31:20,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-07-12 18:31:20,658 INFO [PEWorker-1] replication.AddPeerProcedure(102): Successfully added ENABLED peer 1, config clusterKey=127.0.0.1:64028:/2,replicationEndpointImpl=null,replicateAllUserTables=true,bandwidth=0,serial=false 2023-07-12 18:31:20,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 220 msec 2023-07-12 18:31:20,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; org.apache.hadoop.hbase.master.replication.AddPeerProcedure in 392 msec 2023-07-12 18:31:20,672 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x1fc3c7bf to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:20,672 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x300b6ca6 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:20,689 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@21760f30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:20,689 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@6e87b1cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:20,692 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] zookeeper.RecoverableZooKeeper(93): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:20,692 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] zookeeper.RecoverableZooKeeper(93): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:20,697 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 10x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:20,697 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 10x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:20,698 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] regionserver.ReplicationSource(586): peerId=1, queueId=1 (queues=1) is replicating from cluster=23c3b538-bf67-481b-8351-f0e7ae087693 to cluster=3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:20,698 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] regionserver.ReplicationSource(586): peerId=1, queueId=1 (queues=1) is replicating from cluster=23c3b538-bf67-481b-8351-f0e7ae087693 to cluster=3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:20,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): connection to cluster: 1-0x1008273886f0017 connected 2023-07-12 18:31:20,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): connection to cluster: 1-0x1008273886f0018 connected 2023-07-12 18:31:20,703 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] regionserver.ReplicationSource(346): peerId=1, starting shipping worker for walGroupId=jenkins-hbase20.apache.org%2C40805%2C1689186672112 2023-07-12 18:31:20,703 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] regionserver.ReplicationSource(346): peerId=1, starting shipping worker for walGroupId=jenkins-hbase20.apache.org%2C37271%2C1689186672154 2023-07-12 18:31:20,711 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] regionserver.ReplicationSourceWALReader(119): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2023-07-12 18:31:20,711 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1] regionserver.ReplicationSourceWALReader(119): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2023-07-12 18:31:20,712 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceShipper(98): Running ReplicationSourceShipper Thread for wal group: jenkins-hbase20.apache.org%2C40805%2C1689186672112 2023-07-12 18:31:20,714 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceShipper(98): Running ReplicationSourceShipper Thread for wal group: jenkins-hbase20.apache.org%2C37271%2C1689186672154 2023-07-12 18:31:20,832 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 385 2023-07-12 18:31:20,832 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceWALReader(162): Read 0 WAL entries eligible for replication 2023-07-12 18:31:20,832 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 385 2023-07-12 18:31:20,832 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 903 2023-07-12 18:31:20,832 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708, lastWalPosition=385, nbRowKeys=0, nbHFiles=0, heapSize=0, lastSeqIds={}, endOfFile=false,usedBufferSize=0] 2023-07-12 18:31:20,832 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceWALReader(162): Read 0 WAL entries eligible for replication 2023-07-12 18:31:20,832 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 903 2023-07-12 18:31:20,832 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154/jenkins-hbase20.apache.org%2C37271%2C1689186672154.1689186673708, lastWalPosition=903, nbRowKeys=0, nbHFiles=0, heapSize=0, lastSeqIds={}, endOfFile=false,usedBufferSize=0] 2023-07-12 18:31:20,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40897] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-12 18:31:20,885 DEBUG [Listener at localhost.localdomain/40201] replication.TestReplicationSyncUpTool(91): putAndReplicateRows 2023-07-12 18:31:20,887 DEBUG [hconnection-0x47a7a06f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:20,889 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:20,942 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 385 2023-07-12 18:31:20,948 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 3193 2023-07-12 18:31:20,949 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceWALReader(162): Read 22 WAL entries eligible for replication 2023-07-12 18:31:20,949 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 3193 2023-07-12 18:31:20,949 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[{t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/4=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/5=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/6=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/7=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/8=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/9=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/10=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/11=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/12=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/13=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/14=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/15=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/16=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/17=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/18=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/19=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/20=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/21=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/22=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/23=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/24=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/25=[#edits: 1 = ],208}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154/jenkins-hbase20.apache.org%2C37271%2C1689186672154.1689186673708, lastWalPosition=3193, nbRowKeys=22, nbHFiles=0, heapSize=4576, lastSeqIds={}, endOfFile=false,usedBufferSize=4576] 2023-07-12 18:31:20,964 DEBUG [SinkThread-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:20,967 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=AdminService 2023-07-12 18:31:20,971 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=41549] regionserver.ReplicationSink(263): Started replicating mutations. 2023-07-12 18:31:20,972 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=41549] zookeeper.ReadOnlyZKClient(139): Connect 0x792231e5 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:20,978 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=41549] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@6191acdb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:20,989 DEBUG [hconnection-0x280fc1bc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:20,990 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,024 DEBUG [hconnection-0x280fc1bc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:21,027 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,052 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 385 2023-07-12 18:31:21,061 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=41549] regionserver.ReplicationSink(267): Finished replicating mutations. 2023-07-12 18:31:21,071 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 9808 2023-07-12 18:31:21,071 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceWALReader(162): Read 63 WAL entries eligible for replication 2023-07-12 18:31:21,071 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 9808 2023-07-12 18:31:21,072 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[{t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/26=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/27=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/28=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/29=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/30=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/31=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/32=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/33=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/34=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/35=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/36=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/37=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/38=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/39=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/40=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/41=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/42=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/43=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/44=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/45=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/46=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/47=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/48=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/49=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/50=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/51=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/52=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/53=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/54=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/55=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/56=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/57=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/58=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/59=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/60=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/61=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/62=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/63=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/64=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/65=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/66=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/67=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/68=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/69=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/70=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/71=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/72=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/73=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/74=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/75=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/76=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/77=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/78=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/79=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/80=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/81=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/82=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/83=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/84=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/85=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/86=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/87=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/88=[#edits: 1 = ],208}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154/jenkins-hbase20.apache.org%2C37271%2C1689186672154.1689186673708, lastWalPosition=9808, nbRowKeys=63, nbHFiles=0, heapSize=13104, lastSeqIds={}, endOfFile=false,usedBufferSize=13104] 2023-07-12 18:31:21,076 DEBUG [SinkThread-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:21,078 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=AdminService 2023-07-12 18:31:21,081 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34413] regionserver.ReplicationSink(263): Started replicating mutations. 2023-07-12 18:31:21,082 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34413] zookeeper.ReadOnlyZKClient(139): Connect 0x23fa8c4a to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:21,091 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@4c39c9d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:21,093 DEBUG [hconnection-0x12932a21-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:21,095 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,097 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:21,102 DEBUG [hconnection-0x12932a21-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:21,103 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,106 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,116 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34413] regionserver.ReplicationSink(267): Finished replicating mutations. 2023-07-12 18:31:21,165 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 2885 2023-07-12 18:31:21,165 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceWALReader(162): Read 24 WAL entries eligible for replication 2023-07-12 18:31:21,165 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 2885 2023-07-12 18:31:21,165 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[{t2_syncup/93e6956722d05ec4972c3a5270b9ac18/4=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/5=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/6=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/7=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/8=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/9=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/10=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/11=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/12=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/13=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/14=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/15=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/16=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/17=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/18=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/19=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/20=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/21=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/22=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/23=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/24=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/25=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/26=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/27=[#edits: 1 = ],208}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708, lastWalPosition=2885, nbRowKeys=24, nbHFiles=0, heapSize=4992, lastSeqIds={}, endOfFile=false,usedBufferSize=4992] 2023-07-12 18:31:21,169 DEBUG [SinkThread-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:21,171 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=AdminService 2023-07-12 18:31:21,172 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34681] regionserver.ReplicationSink(263): Started replicating mutations. 2023-07-12 18:31:21,173 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34681] zookeeper.ReadOnlyZKClient(139): Connect 0x3aeb8279 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:21,182 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34681] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@342c6b54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:21,186 DEBUG [hconnection-0x3013e909-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:21,188 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,189 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:21,189 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceWALReader(162): Read 15 WAL entries eligible for replication 2023-07-12 18:31:21,189 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:21,190 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[{t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/89=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/90=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/91=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/92=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/93=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/94=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/95=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/96=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/97=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/98=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/99=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/100=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/101=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/102=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/103=[#edits: 1 = ],208}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154/jenkins-hbase20.apache.org%2C37271%2C1689186672154.1689186673708, lastWalPosition=11494, nbRowKeys=15, nbHFiles=0, heapSize=3120, lastSeqIds={}, endOfFile=false,usedBufferSize=3120] 2023-07-12 18:31:21,197 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 18:31:21,198 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 18:31:21,200 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=41549] regionserver.ReplicationSink(263): Started replicating mutations. 2023-07-12 18:31:21,210 DEBUG [hconnection-0x3013e909-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:21,212 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,215 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=41549] regionserver.ReplicationSink(267): Finished replicating mutations. 2023-07-12 18:31:21,217 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34681] regionserver.ReplicationSink(267): Finished replicating mutations. 2023-07-12 18:31:21,283 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 10025 2023-07-12 18:31:21,283 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceWALReader(162): Read 68 WAL entries eligible for replication 2023-07-12 18:31:21,283 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 10025 2023-07-12 18:31:21,284 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[{t2_syncup/93e6956722d05ec4972c3a5270b9ac18/28=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/29=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/30=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/31=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/32=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/33=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/34=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/35=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/36=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/37=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/38=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/39=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/40=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/41=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/42=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/43=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/44=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/45=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/46=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/47=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/48=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/49=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/50=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/51=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/52=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/53=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/54=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/55=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/56=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/57=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/58=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/59=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/60=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/61=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/62=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/63=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/64=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/65=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/66=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/67=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/68=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/69=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/70=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/71=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/72=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/73=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/74=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/75=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/76=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/77=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/78=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/79=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/80=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/81=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/82=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/83=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/84=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/85=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/86=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/87=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/88=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/89=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/90=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/91=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/92=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/93=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/94=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/95=[#edits: 1 = ],208}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708, lastWalPosition=10025, nbRowKeys=68, nbHFiles=0, heapSize=14144, lastSeqIds={}, endOfFile=false,usedBufferSize=14144] 2023-07-12 18:31:21,289 DEBUG [SinkThread-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:21,291 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=AdminService 2023-07-12 18:31:21,294 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=42439] regionserver.ReplicationSink(263): Started replicating mutations. 2023-07-12 18:31:21,294 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=42439] zookeeper.ReadOnlyZKClient(139): Connect 0x514f937b to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:21,304 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:21,306 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=42439] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@5f886722, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:21,308 DEBUG [hconnection-0x5bb7f80b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:21,309 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,317 DEBUG [hconnection-0x5bb7f80b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:21,319 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,324 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=42439] regionserver.ReplicationSink(267): Finished replicating mutations. 2023-07-12 18:31:21,399 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 17321 2023-07-12 18:31:21,400 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceWALReader(162): Read 68 WAL entries eligible for replication 2023-07-12 18:31:21,400 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 17321 2023-07-12 18:31:21,400 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[{t2_syncup/93e6956722d05ec4972c3a5270b9ac18/96=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/97=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/98=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/99=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/100=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/101=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/102=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/103=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/104=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/105=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/106=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/107=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/108=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/109=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/110=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/111=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/112=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/113=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/114=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/115=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/116=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/117=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/118=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/119=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/120=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/121=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/122=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/123=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/124=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/125=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/126=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/127=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/128=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/129=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/130=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/131=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/132=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/133=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/134=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/135=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/136=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/137=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/138=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/139=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/140=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/141=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/142=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/143=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/144=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/145=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/146=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/147=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/148=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/149=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/150=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/151=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/152=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/153=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/154=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/155=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/156=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/157=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/158=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/159=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/160=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/161=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/162=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/163=[#edits: 1 = ],208}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708, lastWalPosition=17321, nbRowKeys=68, nbHFiles=0, heapSize=14144, lastSeqIds={}, endOfFile=false,usedBufferSize=14144] 2023-07-12 18:31:21,401 DEBUG [SinkThread-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:21,403 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=AdminService 2023-07-12 18:31:21,406 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34413] regionserver.ReplicationSink(263): Started replicating mutations. 2023-07-12 18:31:21,417 DEBUG [hconnection-0x12932a21-shared-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:21,419 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,424 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34413] regionserver.ReplicationSink(267): Finished replicating mutations. 2023-07-12 18:31:21,428 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:21,512 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:21,512 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceWALReader(162): Read 40 WAL entries eligible for replication 2023-07-12 18:31:21,512 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:21,512 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[{t2_syncup/93e6956722d05ec4972c3a5270b9ac18/164=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/165=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/166=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/167=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/168=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/169=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/170=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/171=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/172=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/173=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/174=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/175=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/176=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/177=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/178=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/179=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/180=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/181=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/182=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/183=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/184=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/185=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/186=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/187=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/188=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/189=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/190=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/191=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/192=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/193=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/194=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/195=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/196=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/197=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/198=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/199=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/200=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/201=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/202=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/203=[#edits: 1 = ],208}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708, lastWalPosition=21753, nbRowKeys=40, nbHFiles=0, heapSize=8320, lastSeqIds={}, endOfFile=false,usedBufferSize=8320] 2023-07-12 18:31:21,515 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34413] regionserver.ReplicationSink(263): Started replicating mutations. 2023-07-12 18:31:21,519 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=34413] regionserver.ReplicationSink(267): Finished replicating mutations. 2023-07-12 18:31:21,537 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:21,624 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:21,646 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:21,671 INFO [jenkins-hbase20:34681Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:21,672 INFO [jenkins-hbase20:34681Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Sink: age in ms of last applied edit: 0, total replicated edits: 24 2023-07-12 18:31:21,696 INFO [jenkins-hbase20:41549Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:21,696 INFO [jenkins-hbase20:41549Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Sink: age in ms of last applied edit: 0, total replicated edits: 37 2023-07-12 18:31:21,711 INFO [jenkins-hbase20:42439Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:21,711 INFO [jenkins-hbase20:42439Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Sink: age in ms of last applied edit: 0, total replicated edits: 68 2023-07-12 18:31:21,713 INFO [jenkins-hbase20:34413Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:21,713 INFO [jenkins-hbase20:34413Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Sink: age in ms of last applied edit: 0, total replicated edits: 171 2023-07-12 18:31:21,736 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:21,755 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:21,844 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:21,870 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:21,951 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:21,964 DEBUG [hconnection-0x1b5beb5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:21,966 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,971 DEBUG [hconnection-0x1b5beb5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:21,973 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:21,980 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:21,998 DEBUG [hconnection-0x1b5beb5-shared-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:22,000 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:22,007 DEBUG [Listener at localhost.localdomain/40201] replication.TestReplicationSyncUpTool(145): mimicSyncUpAfterDelete 2023-07-12 18:31:22,007 INFO [Listener at localhost.localdomain/40201] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 18:31:22,007 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c6d8e64 to 127.0.0.1:64028 2023-07-12 18:31:22,007 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,008 DEBUG [Listener at localhost.localdomain/40201] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 18:31:22,008 DEBUG [Listener at localhost.localdomain/40201] util.JVMClusterUtil(257): Found active master hash=2060422959, stopped=false 2023-07-12 18:31:22,008 INFO [Listener at localhost.localdomain/40201] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,41741,1689186676019 2023-07-12 18:31:22,012 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/running 2023-07-12 18:31:22,012 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/running 2023-07-12 18:31:22,012 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/running 2023-07-12 18:31:22,013 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/running 2023-07-12 18:31:22,013 INFO [Listener at localhost.localdomain/40201] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 18:31:22,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:22,015 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7127d88c to 127.0.0.1:64028 2023-07-12 18:31:22,012 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/running 2023-07-12 18:31:22,015 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:22,015 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:22,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:22,015 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,34681,1689186676059' ***** 2023-07-12 18:31:22,015 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:31:22,016 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,42439,1689186676093' ***** 2023-07-12 18:31:22,016 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:31:22,016 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,41549,1689186676122' ***** 2023-07-12 18:31:22,016 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:31:22,016 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,34413,1689186676157' ***** 2023-07-12 18:31:22,016 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:31:22,016 INFO [RS:1;jenkins-hbase20:42439] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:31:22,016 INFO [RS:2;jenkins-hbase20:41549] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:31:22,016 INFO [RS:0;jenkins-hbase20:34681] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:31:22,016 INFO [RS:3;jenkins-hbase20:34413] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:31:22,016 INFO [RS:1;jenkins-hbase20:42439] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:31:22,017 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:31:22,017 INFO [RS:2;jenkins-hbase20:41549] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:31:22,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:22,017 INFO [RS:1;jenkins-hbase20:42439] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:31:22,017 INFO [RS:0;jenkins-hbase20:34681] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:31:22,017 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:31:22,017 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:31:22,017 INFO [RS:3;jenkins-hbase20:34413] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:31:22,016 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:31:22,020 INFO [RS:3;jenkins-hbase20:34413] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:31:22,022 INFO [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(3305): Received CLOSE for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:22,019 INFO [RS:0;jenkins-hbase20:34681] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:31:22,018 INFO [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:22,022 INFO [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(3305): Received CLOSE for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:22,022 DEBUG [RS:1;jenkins-hbase20:42439] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69f2c45a to 127.0.0.1:64028 2023-07-12 18:31:22,017 INFO [RS:2;jenkins-hbase20:41549] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:31:22,024 INFO [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(3305): Received CLOSE for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:22,022 INFO [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:22,022 DEBUG [RS:1;jenkins-hbase20:42439] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:22,025 INFO [RS:1;jenkins-hbase20:42439] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:31:22,025 DEBUG [RS:3;jenkins-hbase20:34413] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x767c4057 to 127.0.0.1:64028 2023-07-12 18:31:22,025 INFO [RS:1;jenkins-hbase20:42439] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:31:22,025 DEBUG [RS:3;jenkins-hbase20:34413] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,025 INFO [RS:1;jenkins-hbase20:42439] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:31:22,025 INFO [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 18:31:22,025 INFO [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 18:31:22,025 DEBUG [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1478): Online Regions={63272e89b8aafccb1ffb2f93ed48b12c=hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.} 2023-07-12 18:31:22,026 INFO [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:22,026 DEBUG [RS:0;jenkins-hbase20:34681] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55e54aa2 to 127.0.0.1:64028 2023-07-12 18:31:22,026 DEBUG [RS:0;jenkins-hbase20:34681] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,026 INFO [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 18:31:22,026 DEBUG [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1478): Online Regions={e22f590dd8a98a0fba12251b93336902=t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.} 2023-07-12 18:31:22,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 63272e89b8aafccb1ffb2f93ed48b12c, disabling compactions & flushes 2023-07-12 18:31:22,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e22f590dd8a98a0fba12251b93336902, disabling compactions & flushes 2023-07-12 18:31:22,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:22,028 INFO [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:22,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:22,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:22,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. after waiting 0 ms 2023-07-12 18:31:22,028 DEBUG [RS:2;jenkins-hbase20:41549] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25f569ac to 127.0.0.1:64028 2023-07-12 18:31:22,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:22,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:22,028 DEBUG [RS:2;jenkins-hbase20:41549] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. after waiting 0 ms 2023-07-12 18:31:22,028 INFO [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 18:31:22,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:22,028 DEBUG [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1478): Online Regions={bde3b0e33054f5210b7a78be27604e3f=t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.} 2023-07-12 18:31:22,029 DEBUG [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1504): Waiting on e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:22,029 DEBUG [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1504): Waiting on bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:22,029 INFO [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 18:31:22,029 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-12 18:31:22,029 DEBUG [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1504): Waiting on 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:22,029 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 18:31:22,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 63272e89b8aafccb1ffb2f93ed48b12c 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 18:31:22,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e22f590dd8a98a0fba12251b93336902 2/2 column families, dataSize=3.40 KB heapSize=11.44 KB 2023-07-12 18:31:22,030 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 18:31:22,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bde3b0e33054f5210b7a78be27604e3f, disabling compactions & flushes 2023-07-12 18:31:22,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:22,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:22,031 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 18:31:22,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 18:31:22,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 18:31:22,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 18:31:22,031 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.66 KB heapSize=7.06 KB 2023-07-12 18:31:22,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. after waiting 0 ms 2023-07-12 18:31:22,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:22,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing bde3b0e33054f5210b7a78be27604e3f 2/2 column families, dataSize=7.01 KB heapSize=22.38 KB 2023-07-12 18:31:22,050 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:22,062 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:22,090 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:22,092 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:22,093 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:22,093 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:22,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.40 KB at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/.tmp/cf1/ca6edfd8870545488777f98352cb93e2 2023-07-12 18:31:22,175 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:22,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=7.01 KB at sequenceid=8 (bloomFilter=true), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/.tmp/cf1/3a4b74c213ec46f7865410bb78e1144c 2023-07-12 18:31:22,198 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:22,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/.tmp/cf1/3a4b74c213ec46f7865410bb78e1144c as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1/3a4b74c213ec46f7865410bb78e1144c 2023-07-12 18:31:22,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/.tmp/cf1/ca6edfd8870545488777f98352cb93e2 as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1/ca6edfd8870545488777f98352cb93e2 2023-07-12 18:31:22,229 DEBUG [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1504): Waiting on bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:22,229 DEBUG [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1504): Waiting on e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:22,229 DEBUG [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1504): Waiting on 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:22,229 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 18:31:22,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1/3a4b74c213ec46f7865410bb78e1144c, entries=200, sequenceid=8, filesize=12.2 K 2023-07-12 18:31:22,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1/ca6edfd8870545488777f98352cb93e2, entries=100, sequenceid=7, filesize=8.3 K 2023-07-12 18:31:22,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~7.01 KB/7180, heapSize ~22.11 KB/22640, currentSize=0 B/0 for bde3b0e33054f5210b7a78be27604e3f in 208ms, sequenceid=8, compaction requested=false 2023-07-12 18:31:22,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.40 KB/3480, heapSize ~11.17 KB/11440, currentSize=0 B/0 for e22f590dd8a98a0fba12251b93336902 in 212ms, sequenceid=7, compaction requested=false 2023-07-12 18:31:22,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2023-07-12 18:31:22,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-07-12 18:31:22,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:22,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bde3b0e33054f5210b7a78be27604e3f: 2023-07-12 18:31:22,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:22,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:22,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e22f590dd8a98a0fba12251b93336902: 2023-07-12 18:31:22,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:22,283 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:22,309 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:22,392 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:22,420 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:22,429 INFO [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,41549,1689186676122; all regions closed. 2023-07-12 18:31:22,429 INFO [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,34681,1689186676059; all regions closed. 2023-07-12 18:31:22,429 DEBUG [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1504): Waiting on 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:22,429 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 18:31:22,445 DEBUG [RS:2;jenkins-hbase20:41549] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs 2023-07-12 18:31:22,445 DEBUG [RS:0;jenkins-hbase20:34681] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs 2023-07-12 18:31:22,445 INFO [RS:0;jenkins-hbase20:34681] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34681%2C1689186676059:(num 1689186676802) 2023-07-12 18:31:22,445 INFO [RS:2;jenkins-hbase20:41549] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41549%2C1689186676122:(num 1689186676806) 2023-07-12 18:31:22,445 DEBUG [RS:0;jenkins-hbase20:34681] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,446 DEBUG [RS:2;jenkins-hbase20:41549] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,446 INFO [RS:0;jenkins-hbase20:34681] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:22,446 INFO [RS:2;jenkins-hbase20:41549] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:22,446 INFO [RS:2;jenkins-hbase20:41549] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 18:31:22,446 INFO [RS:0;jenkins-hbase20:34681] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 18:31:22,447 INFO [RS:0;jenkins-hbase20:34681] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:31:22,447 INFO [RS:2;jenkins-hbase20:41549] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:31:22,447 INFO [RS:2;jenkins-hbase20:41549] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:31:22,447 INFO [RS:2;jenkins-hbase20:41549] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:31:22,447 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:22,447 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:22,447 INFO [RS:0;jenkins-hbase20:34681] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:31:22,448 INFO [RS:0;jenkins-hbase20:34681] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:31:22,448 DEBUG [RS:2;jenkins-hbase20:41549] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x792231e5 to 127.0.0.1:64028 2023-07-12 18:31:22,448 DEBUG [RS:2;jenkins-hbase20:41549] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,448 DEBUG [RS:0;jenkins-hbase20:34681] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aeb8279 to 127.0.0.1:64028 2023-07-12 18:31:22,448 DEBUG [RS:0;jenkins-hbase20:34681] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,450 INFO [RS:0;jenkins-hbase20:34681] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34681 2023-07-12 18:31:22,450 INFO [RS:2;jenkins-hbase20:41549] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41549 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,464 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0017, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:22,464 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:22,464 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0018, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,41549,1689186676122 2023-07-12 18:31:22,464 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,464 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34681,1689186676059] 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:22,464 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,465 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34681,1689186676059; numProcessing=1 2023-07-12 18:31:22,465 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,34681,1689186676059 2023-07-12 18:31:22,465 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /2/draining/jenkins-hbase20.apache.org,34681,1689186676059 already deleted, retry=false 2023-07-12 18:31:22,465 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34681,1689186676059 expired; onlineServers=3 2023-07-12 18:31:22,465 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,41549,1689186676122] 2023-07-12 18:31:22,465 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41549,1689186676122; numProcessing=2 2023-07-12 18:31:22,466 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /2/draining/jenkins-hbase20.apache.org,41549,1689186676122 already deleted, retry=false 2023-07-12 18:31:22,466 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,41549,1689186676122 expired; onlineServers=2 2023-07-12 18:31:22,501 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:22,533 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:22,571 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.40 KB at sequenceid=19 (bloomFilter=false), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/.tmp/info/713a0feaf4e4481298e78a8b6112e9f1 2023-07-12 18:31:22,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/.tmp/info/1d076a2957f24c2c974ca0e26f8c2633 2023-07-12 18:31:22,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/.tmp/info/1d076a2957f24c2c974ca0e26f8c2633 as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/info/1d076a2957f24c2c974ca0e26f8c2633 2023-07-12 18:31:22,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/info/1d076a2957f24c2c974ca0e26f8c2633, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 18:31:22,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 63272e89b8aafccb1ffb2f93ed48b12c in 567ms, sequenceid=6, compaction requested=false 2023-07-12 18:31:22,612 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:22,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=258 B at sequenceid=19 (bloomFilter=false), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/.tmp/table/d68a2991dfeb4319a19d0b56203be4d4 2023-07-12 18:31:22,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:31:22,617 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:22,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:22,617 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34681-0x1008273886f0008, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:22,617 INFO [RS:0;jenkins-hbase20:34681] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,34681,1689186676059; zookeeper connection closed. 2023-07-12 18:31:22,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 63272e89b8aafccb1ffb2f93ed48b12c: 2023-07-12 18:31:22,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:22,619 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@72881f22] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@72881f22 2023-07-12 18:31:22,625 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/.tmp/info/713a0feaf4e4481298e78a8b6112e9f1 as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info/713a0feaf4e4481298e78a8b6112e9f1 2023-07-12 18:31:22,629 INFO [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,34413,1689186676157; all regions closed. 2023-07-12 18:31:22,629 DEBUG [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 18:31:22,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info/713a0feaf4e4481298e78a8b6112e9f1, entries=30, sequenceid=19, filesize=8.1 K 2023-07-12 18:31:22,636 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/.tmp/table/d68a2991dfeb4319a19d0b56203be4d4 as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/table/d68a2991dfeb4319a19d0b56203be4d4 2023-07-12 18:31:22,637 DEBUG [RS:3;jenkins-hbase20:34413] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs 2023-07-12 18:31:22,637 INFO [RS:3;jenkins-hbase20:34413] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34413%2C1689186676157:(num 1689186676834) 2023-07-12 18:31:22,637 DEBUG [RS:3;jenkins-hbase20:34413] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,637 INFO [RS:3;jenkins-hbase20:34413] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:22,638 INFO [RS:3;jenkins-hbase20:34413] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 18:31:22,638 INFO [RS:3;jenkins-hbase20:34413] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:31:22,638 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:22,638 INFO [RS:3;jenkins-hbase20:34413] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:31:22,639 INFO [RS:3;jenkins-hbase20:34413] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:31:22,639 DEBUG [RS:3;jenkins-hbase20:34413] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23fa8c4a to 127.0.0.1:64028 2023-07-12 18:31:22,639 DEBUG [RS:3;jenkins-hbase20:34413] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,641 INFO [RS:3;jenkins-hbase20:34413] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34413 2023-07-12 18:31:22,641 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:22,642 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:22,642 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,34413,1689186676157 2023-07-12 18:31:22,643 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,643 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0017, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,643 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0018, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,643 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:31:22,643 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:31:22,643 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34413,1689186676157] 2023-07-12 18:31:22,643 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34413,1689186676157; numProcessing=3 2023-07-12 18:31:22,644 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /2/draining/jenkins-hbase20.apache.org,34413,1689186676157 already deleted, retry=false 2023-07-12 18:31:22,644 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34413,1689186676157 expired; onlineServers=1 2023-07-12 18:31:22,648 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/table/d68a2991dfeb4319a19d0b56203be4d4, entries=6, sequenceid=19, filesize=4.8 K 2023-07-12 18:31:22,648 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.66 KB/3744, heapSize ~6.78 KB/6944, currentSize=0 B/0 for 1588230740 in 617ms, sequenceid=19, compaction requested=false 2023-07-12 18:31:22,655 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 18:31:22,655 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 18:31:22,658 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/recovered.edits/22.seqid, newMaxSeqId=22, maxSeqId=1 2023-07-12 18:31:22,658 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 18:31:22,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 18:31:22,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 18:31:22,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 18:31:22,718 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:22,718 INFO [RS:2;jenkins-hbase20:41549] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,41549,1689186676122; zookeeper connection closed. 2023-07-12 18:31:22,718 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:41549-0x1008273886f000a, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:22,720 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2767b861] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2767b861 2023-07-12 18:31:22,722 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:22,749 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:22,830 INFO [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,42439,1689186676093; all regions closed. 2023-07-12 18:31:22,830 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:22,837 DEBUG [RS:1;jenkins-hbase20:42439] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs 2023-07-12 18:31:22,837 INFO [RS:1;jenkins-hbase20:42439] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42439%2C1689186676093.meta:.meta(num 1689186676951) 2023-07-12 18:31:22,845 DEBUG [RS:1;jenkins-hbase20:42439] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs 2023-07-12 18:31:22,845 INFO [RS:1;jenkins-hbase20:42439] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42439%2C1689186676093:(num 1689186676832) 2023-07-12 18:31:22,845 DEBUG [RS:1;jenkins-hbase20:42439] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,845 INFO [RS:1;jenkins-hbase20:42439] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:22,845 INFO [RS:1;jenkins-hbase20:42439] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 18:31:22,845 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:22,846 DEBUG [RS:1;jenkins-hbase20:42439] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x514f937b to 127.0.0.1:64028 2023-07-12 18:31:22,846 DEBUG [RS:1;jenkins-hbase20:42439] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,847 INFO [RS:1;jenkins-hbase20:42439] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42439 2023-07-12 18:31:22,849 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,849 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0018, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,849 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,42439,1689186676093 2023-07-12 18:31:22,849 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0017, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:22,849 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:31:22,849 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:31:22,850 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,42439,1689186676093] 2023-07-12 18:31:22,850 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,42439,1689186676093; numProcessing=4 2023-07-12 18:31:22,851 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /2/draining/jenkins-hbase20.apache.org,42439,1689186676093 already deleted, retry=false 2023-07-12 18:31:22,851 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,42439,1689186676093 expired; onlineServers=0 2023-07-12 18:31:22,851 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,41741,1689186676019' ***** 2023-07-12 18:31:22,851 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 18:31:22,853 DEBUG [M:0;jenkins-hbase20:41741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ef004ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:22,853 INFO [M:0;jenkins-hbase20:41741] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,41741,1689186676019 2023-07-12 18:31:22,853 INFO [M:0;jenkins-hbase20:41741] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,41741,1689186676019; all regions closed. 2023-07-12 18:31:22,853 DEBUG [M:0;jenkins-hbase20:41741] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:22,853 DEBUG [M:0;jenkins-hbase20:41741] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 18:31:22,853 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 18:31:22,853 DEBUG [M:0;jenkins-hbase20:41741] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 18:31:22,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186676433] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186676433,5,FailOnTimeoutGroup] 2023-07-12 18:31:22,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186676434] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186676434,5,FailOnTimeoutGroup] 2023-07-12 18:31:22,854 INFO [M:0;jenkins-hbase20:41741] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 18:31:22,856 INFO [M:0;jenkins-hbase20:41741] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 18:31:22,856 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/master 2023-07-12 18:31:22,856 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:22,856 INFO [M:0;jenkins-hbase20:41741] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-07-12 18:31:22,857 DEBUG [M:0;jenkins-hbase20:41741] master.HMaster(1512): Stopping service threads 2023-07-12 18:31:22,857 INFO [M:0;jenkins-hbase20:41741] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 18:31:22,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:31:22,858 ERROR [M:0;jenkins-hbase20:41741] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] 2023-07-12 18:31:22,859 INFO [M:0;jenkins-hbase20:41741] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 18:31:22,860 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 18:31:22,860 DEBUG [M:0;jenkins-hbase20:41741] zookeeper.ZKUtil(398): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Unable to get data of znode /2/master because node does not exist (not an error) 2023-07-12 18:31:22,860 WARN [M:0;jenkins-hbase20:41741] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 18:31:22,860 INFO [M:0;jenkins-hbase20:41741] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 18:31:22,861 INFO [M:0;jenkins-hbase20:41741] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 18:31:22,861 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:22,862 DEBUG [M:0;jenkins-hbase20:41741] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 18:31:22,862 INFO [M:0;jenkins-hbase20:41741] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:22,862 DEBUG [M:0;jenkins-hbase20:41741] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:22,862 DEBUG [M:0;jenkins-hbase20:41741] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 18:31:22,862 DEBUG [M:0;jenkins-hbase20:41741] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:22,863 INFO [M:0;jenkins-hbase20:41741] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.44 KB heapSize=65.21 KB 2023-07-12 18:31:22,881 INFO [M:0;jenkins-hbase20:41741] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.44 KB at sequenceid=116 (bloomFilter=true), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/80dbbba6247c4a9e9f59203ae7d16923 2023-07-12 18:31:22,888 DEBUG [M:0;jenkins-hbase20:41741] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/80dbbba6247c4a9e9f59203ae7d16923 as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/80dbbba6247c4a9e9f59203ae7d16923 2023-07-12 18:31:22,895 INFO [M:0;jenkins-hbase20:41741] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/80dbbba6247c4a9e9f59203ae7d16923, entries=14, sequenceid=116, filesize=8.1 K 2023-07-12 18:31:22,896 INFO [M:0;jenkins-hbase20:41741] regionserver.HRegion(2948): Finished flush of dataSize ~55.44 KB/56773, heapSize ~65.20 KB/66760, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 34ms, sequenceid=116, compaction requested=false 2023-07-12 18:31:22,899 INFO [M:0;jenkins-hbase20:41741] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:22,900 DEBUG [M:0;jenkins-hbase20:41741] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:31:22,906 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:22,906 INFO [M:0;jenkins-hbase20:41741] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 18:31:22,907 INFO [M:0;jenkins-hbase20:41741] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41741 2023-07-12 18:31:22,909 DEBUG [M:0;jenkins-hbase20:41741] zookeeper.RecoverableZooKeeper(172): Node /2/rs/jenkins-hbase20.apache.org,41741,1689186676019 already deleted, retry=false 2023-07-12 18:31:22,937 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:22,973 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:23,021 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:23,021 INFO [M:0;jenkins-hbase20:41741] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,41741,1689186676019; zookeeper connection closed. 2023-07-12 18:31:23,021 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41741-0x1008273886f0007, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:23,043 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:23,080 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:23,122 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:23,122 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:42439-0x1008273886f0009, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:23,122 INFO [RS:1;jenkins-hbase20:42439] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,42439,1689186676093; zookeeper connection closed. 2023-07-12 18:31:23,124 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2ca4727a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2ca4727a 2023-07-12 18:31:23,149 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:23,187 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:23,257 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 21753 2023-07-12 18:31:23,294 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 11494 2023-07-12 18:31:23,322 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:23,322 INFO [RS:3;jenkins-hbase20:34413] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,34413,1689186676157; zookeeper connection closed. 2023-07-12 18:31:23,322 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:34413-0x1008273886f000b, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:23,324 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c060be0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c060be0 2023-07-12 18:31:23,325 INFO [Listener at localhost.localdomain/40201] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 4 regionserver(s) complete 2023-07-12 18:31:23,354 INFO [Listener at localhost.localdomain/40201] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 18:31:23,355 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4324ec28 to 127.0.0.1:64028 2023-07-12 18:31:23,355 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:23,355 DEBUG [Listener at localhost.localdomain/40201] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 18:31:23,355 DEBUG [Listener at localhost.localdomain/40201] util.JVMClusterUtil(257): Found active master hash=722415769, stopped=false 2023-07-12 18:31:23,355 INFO [Listener at localhost.localdomain/40201] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,40897,1689186671073 2023-07-12 18:31:23,356 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/running 2023-07-12 18:31:23,356 INFO [Listener at localhost.localdomain/40201] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 18:31:23,356 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/running 2023-07-12 18:31:23,356 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x341bcbb3 to 127.0.0.1:64028 2023-07-12 18:31:23,356 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:23,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/running 2023-07-12 18:31:23,359 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,40805,1689186672112' ***** 2023-07-12 18:31:23,356 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/running 2023-07-12 18:31:23,359 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:23,359 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:31:23,359 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,37271,1689186672154' ***** 2023-07-12 18:31:23,359 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:31:23,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/running 2023-07-12 18:31:23,360 INFO [RS:0;jenkins-hbase20:40805] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:31:23,360 INFO [RS:0;jenkins-hbase20:40805] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:31:23,360 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:31:23,360 INFO [RS:1;jenkins-hbase20:37271] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:31:23,360 INFO [RS:1;jenkins-hbase20:37271] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:31:23,360 INFO [RS:1;jenkins-hbase20:37271] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:31:23,360 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(3305): Received CLOSE for 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:23,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/running 2023-07-12 18:31:23,361 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:31:23,360 INFO [RS:0;jenkins-hbase20:40805] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:31:23,361 INFO [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(3305): Received CLOSE for 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:23,363 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(3305): Received CLOSE for 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:23,363 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:23,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 80b2b4fe906f78b38a7d69ad08dadb13, disabling compactions & flushes 2023-07-12 18:31:23,369 DEBUG [RS:1;jenkins-hbase20:37271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32c50248 to 127.0.0.1:64028 2023-07-12 18:31:23,363 INFO [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:23,370 DEBUG [RS:1;jenkins-hbase20:37271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:23,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:23,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:23,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 93e6956722d05ec4972c3a5270b9ac18, disabling compactions & flushes 2023-07-12 18:31:23,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. after waiting 0 ms 2023-07-12 18:31:23,370 INFO [RS:1;jenkins-hbase20:37271] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:31:23,370 DEBUG [RS:0;jenkins-hbase20:40805] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3410e7e7 to 127.0.0.1:64028 2023-07-12 18:31:23,371 INFO [RS:1;jenkins-hbase20:37271] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:31:23,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:23,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:23,371 INFO [RS:1;jenkins-hbase20:37271] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:31:23,371 DEBUG [RS:0;jenkins-hbase20:40805] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:23,371 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 18:31:23,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 80b2b4fe906f78b38a7d69ad08dadb13 2/2 column families, dataSize=6.25 KB heapSize=21.71 KB 2023-07-12 18:31:23,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:23,371 INFO [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 18:31:23,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. after waiting 0 ms 2023-07-12 18:31:23,371 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1478): Online Regions={93e6956722d05ec4972c3a5270b9ac18=t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.} 2023-07-12 18:31:23,371 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1504): Waiting on 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:23,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:23,371 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-12 18:31:23,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 93e6956722d05ec4972c3a5270b9ac18 2/2 column families, dataSize=12.70 KB heapSize=42.80 KB 2023-07-12 18:31:23,372 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 18:31:23,372 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1478): Online Regions={80b2b4fe906f78b38a7d69ad08dadb13=t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13., 1588230740=hbase:meta,,1.1588230740, 340cf179e3faa54372c069aa2490aad9=hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.} 2023-07-12 18:31:23,373 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1504): Waiting on 1588230740, 340cf179e3faa54372c069aa2490aad9, 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:23,373 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 18:31:23,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 18:31:23,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 18:31:23,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 18:31:23,373 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.88 KB heapSize=7.44 KB 2023-07-12 18:31:23,378 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 28644 2023-07-12 18:31:23,378 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceWALReader(162): Read 1 WAL entries eligible for replication 2023-07-12 18:31:23,379 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 28644 2023-07-12 18:31:23,379 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[{t2_syncup/93e6956722d05ec4972c3a5270b9ac18/205=[#edits: 100 = ],8120}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708, lastWalPosition=28644, nbRowKeys=100, nbHFiles=0, heapSize=8120, lastSeqIds={}, endOfFile=false,usedBufferSize=8120] 2023-07-12 18:31:23,400 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:23,400 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:23,402 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 15081 2023-07-12 18:31:23,402 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceWALReader(162): Read 1 WAL entries eligible for replication 2023-07-12 18:31:23,402 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 15081 2023-07-12 18:31:23,402 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[{t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/105=[#edits: 50 = ],4120}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154/jenkins-hbase20.apache.org%2C37271%2C1689186672154.1689186673708, lastWalPosition=15081, nbRowKeys=50, nbHFiles=0, heapSize=4120, lastSeqIds={}, endOfFile=false,usedBufferSize=4120] 2023-07-12 18:31:23,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.76 KB at sequenceid=106 (bloomFilter=true), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/.tmp/cf1/b9ded99dd0ea47bdbd03569955226f38 2023-07-12 18:31:23,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9ded99dd0ea47bdbd03569955226f38 2023-07-12 18:31:23,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=106 (bloomFilter=true), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/.tmp/norep/86f9ef8f80a949e7b296fe2ac8abc6e2 2023-07-12 18:31:23,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86f9ef8f80a949e7b296fe2ac8abc6e2 2023-07-12 18:31:23,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/.tmp/cf1/b9ded99dd0ea47bdbd03569955226f38 as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/cf1/b9ded99dd0ea47bdbd03569955226f38 2023-07-12 18:31:23,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9ded99dd0ea47bdbd03569955226f38 2023-07-12 18:31:23,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/cf1/b9ded99dd0ea47bdbd03569955226f38, entries=100, sequenceid=106, filesize=8.2 K 2023-07-12 18:31:23,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/.tmp/norep/86f9ef8f80a949e7b296fe2ac8abc6e2 as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/norep/86f9ef8f80a949e7b296fe2ac8abc6e2 2023-07-12 18:31:23,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86f9ef8f80a949e7b296fe2ac8abc6e2 2023-07-12 18:31:23,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/norep/86f9ef8f80a949e7b296fe2ac8abc6e2, entries=51, sequenceid=106, filesize=6.5 K 2023-07-12 18:31:23,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~6.25 KB/6401, heapSize ~21.68 KB/22200, currentSize=0 B/0 for 80b2b4fe906f78b38a7d69ad08dadb13 in 109ms, sequenceid=106, compaction requested=false 2023-07-12 18:31:23,491 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 28644 2023-07-12 18:31:23,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/recovered.edits/109.seqid, newMaxSeqId=109, maxSeqId=1 2023-07-12 18:31:23,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:23,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 80b2b4fe906f78b38a7d69ad08dadb13: 2023-07-12 18:31:23,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:23,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 340cf179e3faa54372c069aa2490aad9, disabling compactions & flushes 2023-07-12 18:31:23,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:23,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:23,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. after waiting 0 ms 2023-07-12 18:31:23,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:23,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 340cf179e3faa54372c069aa2490aad9 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 18:31:23,509 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 15938 2023-07-12 18:31:23,509 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceWALReader(162): Read 0 WAL entries eligible for replication 2023-07-12 18:31:23,509 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 15938 2023-07-12 18:31:23,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/.tmp/info/05fc832224a34e178069d0d1118bd8c8 2023-07-12 18:31:23,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/.tmp/info/05fc832224a34e178069d0d1118bd8c8 as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/info/05fc832224a34e178069d0d1118bd8c8 2023-07-12 18:31:23,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/info/05fc832224a34e178069d0d1118bd8c8, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 18:31:23,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 340cf179e3faa54372c069aa2490aad9 in 33ms, sequenceid=6, compaction requested=false 2023-07-12 18:31:23,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:31:23,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:23,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 340cf179e3faa54372c069aa2490aad9: 2023-07-12 18:31:23,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:23,548 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 18:31:23,549 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 18:31:23,552 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 18:31:23,552 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 18:31:23,572 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1504): Waiting on 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:23,573 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 18:31:23,583 INFO [jenkins-hbase20:37271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=4120B, Limit=268435456B Normal source for cluster 1: Total replicated edits: 100, current progress: walGroup [jenkins-hbase20.apache.org%2C37271%2C1689186672154]: currently replicating from: hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154/jenkins-hbase20.apache.org%2C37271%2C1689186672154.1689186673708 at position: 11494 2023-07-12 18:31:23,583 INFO [jenkins-hbase20:40805Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=8120B, Limit=268435456B Normal source for cluster 1: Total replicated edits: 200, current progress: walGroup [jenkins-hbase20.apache.org%2C40805%2C1689186672112]: currently replicating from: hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708 at position: 21753 2023-07-12 18:31:23,597 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 28644 2023-07-12 18:31:23,615 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] wal.ProtobufLogReader(420): EOF at position 16524 2023-07-12 18:31:23,615 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1] regionserver.ReplicationSourceWALReader(162): Read 0 WAL entries eligible for replication 2023-07-12 18:31:23,706 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 28644 2023-07-12 18:31:23,773 DEBUG [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1504): Waiting on 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:23,773 DEBUG [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 18:31:23,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=9.74 KB at sequenceid=206 (bloomFilter=true), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/.tmp/cf1/c890b7390e4b45ed9d46cb3a91fd3d0a 2023-07-12 18:31:23,816 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.40 KB at sequenceid=19 (bloomFilter=false), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/.tmp/info/eb0e8ee42e3d4cd5b540060c3e157862 2023-07-12 18:31:23,816 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 28644 2023-07-12 18:31:23,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c890b7390e4b45ed9d46cb3a91fd3d0a 2023-07-12 18:31:23,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=226 B at sequenceid=19 (bloomFilter=false), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/.tmp/rep_barrier/58c8b40dd20a4e3d83d45ca18e14c88a 2023-07-12 18:31:23,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.96 KB at sequenceid=206 (bloomFilter=true), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/.tmp/norep/51d3eaf958514334a8fcf4136ced815e 2023-07-12 18:31:23,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51d3eaf958514334a8fcf4136ced815e 2023-07-12 18:31:23,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/.tmp/cf1/c890b7390e4b45ed9d46cb3a91fd3d0a as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/cf1/c890b7390e4b45ed9d46cb3a91fd3d0a 2023-07-12 18:31:23,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=258 B at sequenceid=19 (bloomFilter=false), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/.tmp/table/7c341cf751f3435f835307747ed1aa5f 2023-07-12 18:31:23,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c890b7390e4b45ed9d46cb3a91fd3d0a 2023-07-12 18:31:23,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/cf1/c890b7390e4b45ed9d46cb3a91fd3d0a, entries=200, sequenceid=206, filesize=11.9 K 2023-07-12 18:31:23,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/.tmp/norep/51d3eaf958514334a8fcf4136ced815e as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/norep/51d3eaf958514334a8fcf4136ced815e 2023-07-12 18:31:23,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51d3eaf958514334a8fcf4136ced815e 2023-07-12 18:31:23,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/norep/51d3eaf958514334a8fcf4136ced815e, entries=101, sequenceid=206, filesize=8.3 K 2023-07-12 18:31:23,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~12.70 KB/13001, heapSize ~42.77 KB/43800, currentSize=0 B/0 for 93e6956722d05ec4972c3a5270b9ac18 in 510ms, sequenceid=206, compaction requested=false 2023-07-12 18:31:23,882 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/.tmp/info/eb0e8ee42e3d4cd5b540060c3e157862 as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/info/eb0e8ee42e3d4cd5b540060c3e157862 2023-07-12 18:31:23,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/recovered.edits/209.seqid, newMaxSeqId=209, maxSeqId=1 2023-07-12 18:31:23,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:23,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 93e6956722d05ec4972c3a5270b9ac18: 2023-07-12 18:31:23,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:23,896 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/info/eb0e8ee42e3d4cd5b540060c3e157862, entries=30, sequenceid=19, filesize=8.1 K 2023-07-12 18:31:23,897 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/.tmp/rep_barrier/58c8b40dd20a4e3d83d45ca18e14c88a as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/rep_barrier/58c8b40dd20a4e3d83d45ca18e14c88a 2023-07-12 18:31:23,903 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/rep_barrier/58c8b40dd20a4e3d83d45ca18e14c88a, entries=2, sequenceid=19, filesize=4.9 K 2023-07-12 18:31:23,905 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/.tmp/table/7c341cf751f3435f835307747ed1aa5f as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/table/7c341cf751f3435f835307747ed1aa5f 2023-07-12 18:31:23,910 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/table/7c341cf751f3435f835307747ed1aa5f, entries=6, sequenceid=19, filesize=4.8 K 2023-07-12 18:31:23,911 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.88 KB/3970, heapSize ~7.39 KB/7568, currentSize=0 B/0 for 1588230740 in 538ms, sequenceid=19, compaction requested=false 2023-07-12 18:31:23,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/recovered.edits/22.seqid, newMaxSeqId=22, maxSeqId=1 2023-07-12 18:31:23,924 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 18:31:23,925 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 18:31:23,925 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 18:31:23,925 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 18:31:23,926 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 29260 2023-07-12 18:31:23,926 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] regionserver.ReplicationSourceWALReader(162): Read 0 WAL entries eligible for replication 2023-07-12 18:31:23,926 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.ProtobufLogReader(420): EOF at position 29260 2023-07-12 18:31:23,973 INFO [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,40805,1689186672112; all regions closed. 2023-07-12 18:31:23,973 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,37271,1689186672154; all regions closed. 2023-07-12 18:31:23,983 DEBUG [RS:0;jenkins-hbase20:40805] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs 2023-07-12 18:31:23,983 INFO [RS:0;jenkins-hbase20:40805] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C40805%2C1689186672112:(num 1689186673708) 2023-07-12 18:31:23,983 DEBUG [RS:0;jenkins-hbase20:40805] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:23,983 DEBUG [RS:1;jenkins-hbase20:37271] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs 2023-07-12 18:31:23,983 INFO [RS:0;jenkins-hbase20:40805] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:23,983 INFO [RS:1;jenkins-hbase20:37271] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C37271%2C1689186672154.meta:.meta(num 1689186673831) 2023-07-12 18:31:23,983 INFO [RS:0;jenkins-hbase20:40805] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 18:31:23,984 INFO [RS:0;jenkins-hbase20:40805] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:31:23,984 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:23,984 INFO [RS:0;jenkins-hbase20:40805] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:31:23,984 INFO [RS:0;jenkins-hbase20:40805] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:31:23,984 INFO [RS:0;jenkins-hbase20:40805] regionserver.ReplicationSource(656): peerId=1, Closing source 1 because: Region server is closing 2023-07-12 18:31:23,993 DEBUG [RS:1;jenkins-hbase20:37271] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs 2023-07-12 18:31:23,993 INFO [RS:1;jenkins-hbase20:37271] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C37271%2C1689186672154:(num 1689186673708) 2023-07-12 18:31:23,993 DEBUG [RS:1;jenkins-hbase20:37271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:23,993 INFO [RS:1;jenkins-hbase20:37271] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:23,993 INFO [RS:1;jenkins-hbase20:37271] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 18:31:23,994 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:23,994 INFO [RS:1;jenkins-hbase20:37271] regionserver.ReplicationSource(656): peerId=1, Closing source 1 because: Region server is closing 2023-07-12 18:31:24,028 INFO [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1] wal.AbstractFSWALProvider(464): Log hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708 was moved to hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708 2023-07-12 18:31:24,089 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0018, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:24,089 DEBUG [RS:0;jenkins-hbase20:40805] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x300b6ca6 to 127.0.0.1:64028 2023-07-12 18:31:24,089 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0018, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:24,089 DEBUG [RS:0;jenkins-hbase20:40805] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:24,090 INFO [RS:0;jenkins-hbase20:40805] regionserver.ReplicationSource(710): peerId=1, ReplicationSourceWorker RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1 terminated 2023-07-12 18:31:24,092 INFO [RS:0;jenkins-hbase20:40805] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:40805 2023-07-12 18:31:24,104 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/rs 2023-07-12 18:31:24,104 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/rs/jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:24,104 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/rs/jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:24,104 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/rs 2023-07-12 18:31:24,104 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/rs 2023-07-12 18:31:24,105 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,40805,1689186672112] 2023-07-12 18:31:24,105 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,40805,1689186672112; numProcessing=1 2023-07-12 18:31:24,121 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /1/draining/jenkins-hbase20.apache.org,40805,1689186672112 already deleted, retry=false 2023-07-12 18:31:24,121 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,40805,1689186672112 expired; onlineServers=1 2023-07-12 18:31:24,189 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0017, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:24,189 DEBUG [RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0017, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:24,189 DEBUG [RS:1;jenkins-hbase20:37271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fc3c7bf to 127.0.0.1:64028 2023-07-12 18:31:24,190 DEBUG [RS:1;jenkins-hbase20:37271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:24,290 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:24,290 INFO [RS:0;jenkins-hbase20:40805] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,40805,1689186672112; zookeeper connection closed. 2023-07-12 18:31:24,290 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:40805-0x1008273886f0001, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:24,290 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@792336c9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@792336c9 2023-07-12 18:31:24,290 INFO [RS:1;jenkins-hbase20:37271] regionserver.ReplicationSource(710): peerId=1, ReplicationSourceWorker RS_REFRESH_PEER-regionserver/jenkins-hbase20:0-0.replicationSource,1.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1 terminated 2023-07-12 18:31:24,292 INFO [RS:1;jenkins-hbase20:37271] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:37271 2023-07-12 18:31:24,293 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/rs 2023-07-12 18:31:24,294 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/rs/jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:24,294 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,37271,1689186672154] 2023-07-12 18:31:24,295 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,37271,1689186672154; numProcessing=2 2023-07-12 18:31:24,295 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /1/draining/jenkins-hbase20.apache.org,37271,1689186672154 already deleted, retry=false 2023-07-12 18:31:24,295 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,37271,1689186672154 expired; onlineServers=0 2023-07-12 18:31:24,295 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,40897,1689186671073' ***** 2023-07-12 18:31:24,296 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 18:31:24,297 DEBUG [M:0;jenkins-hbase20:40897] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a323aa2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:24,297 INFO [M:0;jenkins-hbase20:40897] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,40897,1689186671073 2023-07-12 18:31:24,297 INFO [M:0;jenkins-hbase20:40897] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,40897,1689186671073; all regions closed. 2023-07-12 18:31:24,297 DEBUG [M:0;jenkins-hbase20:40897] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:24,297 DEBUG [M:0;jenkins-hbase20:40897] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 18:31:24,297 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 18:31:24,297 DEBUG [M:0;jenkins-hbase20:40897] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 18:31:24,297 INFO [M:0;jenkins-hbase20:40897] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 18:31:24,297 INFO [M:0;jenkins-hbase20:40897] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 18:31:24,297 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186673341] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186673341,5,FailOnTimeoutGroup] 2023-07-12 18:31:24,298 INFO [M:0;jenkins-hbase20:40897] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-07-12 18:31:24,298 DEBUG [M:0;jenkins-hbase20:40897] master.HMaster(1512): Stopping service threads 2023-07-12 18:31:24,298 INFO [M:0;jenkins-hbase20:40897] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 18:31:24,297 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186673341] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186673341,5,FailOnTimeoutGroup] 2023-07-12 18:31:24,298 ERROR [M:0;jenkins-hbase20:40897] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] 2023-07-12 18:31:24,299 INFO [M:0;jenkins-hbase20:40897] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 18:31:24,299 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 18:31:24,301 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/master 2023-07-12 18:31:24,301 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:24,301 DEBUG [M:0;jenkins-hbase20:40897] zookeeper.ZKUtil(398): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Unable to get data of znode /1/master because node does not exist (not an error) 2023-07-12 18:31:24,301 WARN [M:0;jenkins-hbase20:40897] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 18:31:24,301 INFO [M:0;jenkins-hbase20:40897] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 18:31:24,301 INFO [M:0;jenkins-hbase20:40897] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 18:31:24,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/master 2023-07-12 18:31:24,302 DEBUG [M:0;jenkins-hbase20:40897] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 18:31:24,302 INFO [M:0;jenkins-hbase20:40897] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:24,302 DEBUG [M:0;jenkins-hbase20:40897] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:24,302 DEBUG [M:0;jenkins-hbase20:40897] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 18:31:24,302 DEBUG [M:0;jenkins-hbase20:40897] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:24,303 INFO [M:0;jenkins-hbase20:40897] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=61.11 KB heapSize=72.63 KB 2023-07-12 18:31:24,321 INFO [M:0;jenkins-hbase20:40897] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=61.11 KB at sequenceid=136 (bloomFilter=true), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3d808d4bb7e24b029519d570d3018423 2023-07-12 18:31:24,327 DEBUG [M:0;jenkins-hbase20:40897] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3d808d4bb7e24b029519d570d3018423 as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3d808d4bb7e24b029519d570d3018423 2023-07-12 18:31:24,337 INFO [M:0;jenkins-hbase20:40897] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3d808d4bb7e24b029519d570d3018423, entries=17, sequenceid=136, filesize=8.5 K 2023-07-12 18:31:24,338 INFO [M:0;jenkins-hbase20:40897] regionserver.HRegion(2948): Finished flush of dataSize ~61.11 KB/62575, heapSize ~72.62 KB/74360, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 35ms, sequenceid=136, compaction requested=false 2023-07-12 18:31:24,340 INFO [M:0;jenkins-hbase20:40897] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:24,340 DEBUG [M:0;jenkins-hbase20:40897] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:31:24,345 INFO [M:0;jenkins-hbase20:40897] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 18:31:24,345 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:24,347 INFO [M:0;jenkins-hbase20:40897] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:40897 2023-07-12 18:31:24,347 DEBUG [M:0;jenkins-hbase20:40897] zookeeper.RecoverableZooKeeper(172): Node /1/rs/jenkins-hbase20.apache.org,40897,1689186671073 already deleted, retry=false 2023-07-12 18:31:24,490 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:24,490 INFO [M:0;jenkins-hbase20:40897] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,40897,1689186671073; zookeeper connection closed. 2023-07-12 18:31:24,490 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): master:40897-0x1008273886f0000, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:24,590 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:24,591 DEBUG [Listener at localhost.localdomain/38071-EventThread] zookeeper.ZKWatcher(600): regionserver:37271-0x1008273886f0002, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:24,591 INFO [RS:1;jenkins-hbase20:37271] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,37271,1689186672154; zookeeper connection closed. 2023-07-12 18:31:24,591 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d37c786] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d37c786 2023-07-12 18:31:24,592 INFO [Listener at localhost.localdomain/40201] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-07-12 18:31:24,595 INFO [Listener at localhost.localdomain/40201] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=18 2023-07-12 18:31:24,596 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:24,596 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:24,597 INFO [Listener at localhost.localdomain/40201] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:24,597 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:24,597 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:24,597 INFO [Listener at localhost.localdomain/40201] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:24,599 INFO [Listener at localhost.localdomain/40201] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41187 2023-07-12 18:31:24,600 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:24,603 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:24,605 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41187 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:24,609 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:411870x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:24,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41187-0x1008273886f001d connected 2023-07-12 18:31:24,613 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:31:24,613 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:24,614 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/acl 2023-07-12 18:31:24,614 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41187 2023-07-12 18:31:24,614 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41187 2023-07-12 18:31:24,615 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41187 2023-07-12 18:31:24,615 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41187 2023-07-12 18:31:24,615 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41187 2023-07-12 18:31:24,615 INFO [Listener at localhost.localdomain/40201] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27, hbase.cluster.distributed=false 2023-07-12 18:31:24,616 DEBUG [pool-442-thread-1] master.MetaRegionLocationCache(164): Updating meta znode for path /2/meta-region-server: INIT 2023-07-12 18:31:24,628 INFO [Listener at localhost.localdomain/40201] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=18 2023-07-12 18:31:24,628 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:24,629 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:24,629 INFO [Listener at localhost.localdomain/40201] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:24,629 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:24,629 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:24,629 INFO [Listener at localhost.localdomain/40201] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:24,630 INFO [Listener at localhost.localdomain/40201] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38715 2023-07-12 18:31:24,631 INFO [Listener at localhost.localdomain/40201] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:31:24,632 DEBUG [Listener at localhost.localdomain/40201] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:31:24,633 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:24,634 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:24,635 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38715 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:24,638 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:387150x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:24,640 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:387150x0, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:31:24,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38715-0x1008273886f001e connected 2023-07-12 18:31:24,641 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:24,642 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/acl 2023-07-12 18:31:24,642 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38715 2023-07-12 18:31:24,642 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38715 2023-07-12 18:31:24,642 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38715 2023-07-12 18:31:24,644 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38715 2023-07-12 18:31:24,644 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38715 2023-07-12 18:31:24,647 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /2/backup-masters/jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:24,655 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/backup-masters 2023-07-12 18:31:24,656 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/backup-masters/jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:24,657 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/master 2023-07-12 18:31:24,657 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/master 2023-07-12 18:31:24,658 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:24,658 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/master 2023-07-12 18:31:24,661 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /2/backup-masters/jenkins-hbase20.apache.org,41187,1689186684595 from backup master directory 2023-07-12 18:31:24,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/master 2023-07-12 18:31:24,662 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/backup-masters/jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:24,662 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:24,662 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/backup-masters 2023-07-12 18:31:24,662 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:24,684 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:24,720 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0d3e0322 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:24,724 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c8a2bbf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:24,724 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:24,725 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 18:31:24,725 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:24,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(288): Renamed hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41741,1689186676019 to hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41741,1689186676019-dead as it is dead 2023-07-12 18:31:24,741 INFO [master/jenkins-hbase20:0:becomeActiveMaster] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41741,1689186676019-dead/jenkins-hbase20.apache.org%2C41741%2C1689186676019.1689186676328 2023-07-12 18:31:24,746 INFO [master/jenkins-hbase20:0:becomeActiveMaster] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41741,1689186676019-dead/jenkins-hbase20.apache.org%2C41741%2C1689186676019.1689186676328 after 5ms 2023-07-12 18:31:24,747 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(300): Renamed hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41741,1689186676019-dead/jenkins-hbase20.apache.org%2C41741%2C1689186676019.1689186676328 to hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C41741%2C1689186676019.1689186676328 2023-07-12 18:31:24,747 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(302): Delete empty local region wal dir hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41741,1689186676019-dead 2023-07-12 18:31:24,748 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:24,750 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41187%2C1689186684595, suffix=, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41187,1689186684595, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/oldWALs, maxLogs=10 2023-07-12 18:31:24,770 DEBUG [RS-EventLoopGroup-12-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK] 2023-07-12 18:31:24,773 DEBUG [RS-EventLoopGroup-12-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK] 2023-07-12 18:31:24,773 DEBUG [RS-EventLoopGroup-12-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK] 2023-07-12 18:31:24,775 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41187,1689186684595/jenkins-hbase20.apache.org%2C41187%2C1689186684595.1689186684751 2023-07-12 18:31:24,775 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK], DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK], DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK]] 2023-07-12 18:31:24,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:24,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:24,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:24,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:24,777 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:24,778 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 18:31:24,779 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 18:31:24,786 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/80dbbba6247c4a9e9f59203ae7d16923 2023-07-12 18:31:24,787 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:24,788 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5179): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals 2023-07-12 18:31:24,788 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C41741%2C1689186676019.1689186676328 2023-07-12 18:31:24,796 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5464): Applied 0, skipped 131, firstSequenceIdInLog=3, maxSequenceIdInLog=118, path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C41741%2C1689186676019.1689186676328 2023-07-12 18:31:24,797 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C41741%2C1689186676019.1689186676328 2023-07-12 18:31:24,801 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:24,804 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/118.seqid, newMaxSeqId=118, maxSeqId=1 2023-07-12 18:31:24,806 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=119; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66602843, jitterRate=-0.007540300488471985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:31:24,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:31:24,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 18:31:24,809 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 18:31:24,809 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 18:31:24,809 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 18:31:24,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 18:31:24,836 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 18:31:24,837 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 18:31:24,837 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 18:31:24,837 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 18:31:24,838 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=t1_syncup 2023-07-12 18:31:24,838 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=12, state=SUCCESS; CreateTableProcedure table=t2_syncup 2023-07-12 18:31:24,839 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 28 msec 2023-07-12 18:31:24,839 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 18:31:24,843 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 18:31:24,844 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,42439,1689186676093, table=hbase:meta, region=1588230740 2023-07-12 18:31:24,845 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 4 possibly 'live' servers, and 0 'splitting'. 2023-07-12 18:31:24,847 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.RecoverableZooKeeper(172): Node /2/draining/jenkins-hbase20.apache.org,34681,1689186676059 already deleted, retry=false 2023-07-12 18:31:24,847 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(568): Processing expiration of jenkins-hbase20.apache.org,34681,1689186676059 on jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:24,855 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,34681,1689186676059, splitWal=true, meta=false 2023-07-12 18:31:24,855 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=15 for jenkins-hbase20.apache.org,34681,1689186676059 (carryingMeta=false) jenkins-hbase20.apache.org,34681,1689186676059/CRASHED/regionCount=0/lock=java.util.concurrent.locks.ReentrantReadWriteLock@498194bd[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-12 18:31:24,862 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.RecoverableZooKeeper(172): Node /2/draining/jenkins-hbase20.apache.org,42439,1689186676093 already deleted, retry=false 2023-07-12 18:31:24,863 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(568): Processing expiration of jenkins-hbase20.apache.org,42439,1689186676093 on jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:24,863 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=16, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,42439,1689186676093, splitWal=true, meta=true 2023-07-12 18:31:24,863 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=16 for jenkins-hbase20.apache.org,42439,1689186676093 (carryingMeta=true) jenkins-hbase20.apache.org,42439,1689186676093/CRASHED/regionCount=1/lock=java.util.concurrent.locks.ReentrantReadWriteLock@2948d0f2[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-12 18:31:24,864 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.RecoverableZooKeeper(172): Node /2/draining/jenkins-hbase20.apache.org,41549,1689186676122 already deleted, retry=false 2023-07-12 18:31:24,864 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(568): Processing expiration of jenkins-hbase20.apache.org,41549,1689186676122 on jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:24,865 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,41549,1689186676122, splitWal=true, meta=false 2023-07-12 18:31:24,865 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=17 for jenkins-hbase20.apache.org,41549,1689186676122 (carryingMeta=false) jenkins-hbase20.apache.org,41549,1689186676122/CRASHED/regionCount=0/lock=java.util.concurrent.locks.ReentrantReadWriteLock@6ca98d1a[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-12 18:31:24,866 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.RecoverableZooKeeper(172): Node /2/draining/jenkins-hbase20.apache.org,34413,1689186676157 already deleted, retry=false 2023-07-12 18:31:24,866 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(568): Processing expiration of jenkins-hbase20.apache.org,34413,1689186676157 on jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:24,867 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,34413,1689186676157, splitWal=true, meta=false 2023-07-12 18:31:24,867 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=18 for jenkins-hbase20.apache.org,34413,1689186676157 (carryingMeta=false) jenkins-hbase20.apache.org,34413,1689186676157/CRASHED/regionCount=0/lock=java.util.concurrent.locks.ReentrantReadWriteLock@47f5865[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-12 18:31:24,880 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 18:31:24,881 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 18:31:24,881 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/balancer 2023-07-12 18:31:24,881 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 18:31:24,882 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/normalizer 2023-07-12 18:31:24,883 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/switch/split 2023-07-12 18:31:24,883 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/switch/merge 2023-07-12 18:31:24,884 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/snapshot-cleanup 2023-07-12 18:31:24,885 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/running 2023-07-12 18:31:24,885 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/running 2023-07-12 18:31:24,885 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:24,885 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,41187,1689186684595, sessionid=0x1008273886f001d, setting cluster-up flag (Was=false) 2023-07-12 18:31:24,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /2/flush-table-proc/acquired, /2/flush-table-proc/reached, /2/flush-table-proc/abort 2023-07-12 18:31:24,891 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 18:31:24,892 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:24,894 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /2/online-snapshot/acquired, /2/online-snapshot/reached, /2/online-snapshot/abort 2023-07-12 18:31:24,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:24,896 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.hbase-snapshot/.tmp 2023-07-12 18:31:24,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:24,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:24,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:24,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:24,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-07-12 18:31:24,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:24,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:24,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:24,909 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689186714909 2023-07-12 18:31:24,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 18:31:24,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 18:31:24,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 18:31:24,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 18:31:24,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 18:31:24,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 18:31:24,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:24,919 DEBUG [PEWorker-3] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41549,1689186676122; numProcessing=1 2023-07-12 18:31:24,919 DEBUG [PEWorker-2] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34681,1689186676059; numProcessing=2 2023-07-12 18:31:24,919 DEBUG [PEWorker-1] master.DeadServer(103): Processing jenkins-hbase20.apache.org,42439,1689186676093; numProcessing=3 2023-07-12 18:31:24,920 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 18:31:24,920 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 18:31:24,920 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 18:31:24,921 DEBUG [PEWorker-4] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34413,1689186676157; numProcessing=4 2023-07-12 18:31:24,922 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 18:31:24,923 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 18:31:24,923 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186684923,5,FailOnTimeoutGroup] 2023-07-12 18:31:24,923 INFO [PEWorker-2] procedure.ServerCrashProcedure(161): Start pid=15, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,34681,1689186676059, splitWal=true, meta=false 2023-07-12 18:31:24,924 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=16, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,42439,1689186676093, splitWal=true, meta=true 2023-07-12 18:31:24,923 INFO [PEWorker-4] procedure.ServerCrashProcedure(161): Start pid=18, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,34413,1689186676157, splitWal=true, meta=false 2023-07-12 18:31:24,924 INFO [PEWorker-3] procedure.ServerCrashProcedure(161): Start pid=17, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41549,1689186676122, splitWal=true, meta=false 2023-07-12 18:31:24,925 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=16, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,42439,1689186676093, splitWal=true, meta=true, isMeta: true 2023-07-12 18:31:24,926 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186684923,5,FailOnTimeoutGroup] 2023-07-12 18:31:24,926 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:24,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 18:31:24,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:24,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:24,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689186684927, completionTime=-1 2023-07-12 18:31:24,927 WARN [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(766): The value of 'hbase.master.wait.on.regionservers.maxtostart' (-1) is set less than 'hbase.master.wait.on.regionservers.mintostart' (1), ignoring. 2023-07-12 18:31:24,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=0; waited=0ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=0ms 2023-07-12 18:31:24,932 DEBUG [PEWorker-1] master.MasterWalManager(318): Renamed region directory: hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,42439,1689186676093-splitting 2023-07-12 18:31:24,934 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,42439,1689186676093-splitting dir is empty, no logs to split. 2023-07-12 18:31:24,934 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,42439,1689186676093 WAL count=0, meta=true 2023-07-12 18:31:24,938 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,42439,1689186676093-splitting dir is empty, no logs to split. 2023-07-12 18:31:24,938 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,42439,1689186676093 WAL count=0, meta=true 2023-07-12 18:31:24,938 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,42439,1689186676093 WAL splitting is done? wals=0, meta=true 2023-07-12 18:31:24,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=19, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 18:31:24,942 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 18:31:24,943 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:24,947 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(951): ClusterId : 3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:24,947 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:31:24,948 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:31:24,949 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:31:24,950 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:31:24,952 DEBUG [RS:0;jenkins-hbase20:38715] zookeeper.ReadOnlyZKClient(139): Connect 0x39d0ecef to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:24,964 DEBUG [RS:0;jenkins-hbase20:38715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@371705a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:24,965 DEBUG [RS:0;jenkins-hbase20:38715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3328879f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:24,976 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:38715 2023-07-12 18:31:24,976 INFO [RS:0;jenkins-hbase20:38715] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:31:24,976 INFO [RS:0;jenkins-hbase20:38715] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:31:24,976 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:31:24,977 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,41187,1689186684595 with isa=jenkins-hbase20.apache.org/148.251.75.209:38715, startcode=1689186684627 2023-07-12 18:31:24,977 DEBUG [RS:0;jenkins-hbase20:38715] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:31:24,989 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57219, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:31:24,994 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41187] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:24,994 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27 2023-07-12 18:31:24,994 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:41891 2023-07-12 18:31:24,994 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:31:24,999 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:25,000 DEBUG [RS:0;jenkins-hbase20:38715] zookeeper.ZKUtil(162): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:25,001 WARN [RS:0;jenkins-hbase20:38715] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:25,001 INFO [RS:0;jenkins-hbase20:38715] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:25,001 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:25,006 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38715,1689186684627] 2023-07-12 18:31:25,016 DEBUG [RS:0;jenkins-hbase20:38715] zookeeper.ZKUtil(162): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:25,018 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.Replication(139): Replication stats-in-log period=5 seconds 2023-07-12 18:31:25,018 INFO [RS:0;jenkins-hbase20:38715] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:31:25,022 INFO [RS:0;jenkins-hbase20:38715] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:31:25,023 INFO [RS:0;jenkins-hbase20:38715] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:31:25,023 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:25,027 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=1; waited=100ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=0ms 2023-07-12 18:31:25,030 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:31:25,034 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:25,034 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:25,034 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:25,034 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:25,034 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:25,035 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:25,035 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:25,035 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:25,035 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:25,035 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:25,035 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:25,037 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:25,038 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:25,038 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:25,051 INFO [RS:0;jenkins-hbase20:38715] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:31:25,051 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38715,1689186684627-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:25,065 INFO [RS:0;jenkins-hbase20:38715] regionserver.Replication(203): jenkins-hbase20.apache.org,38715,1689186684627 started 2023-07-12 18:31:25,065 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,38715,1689186684627, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38715, sessionid=0x1008273886f001e 2023-07-12 18:31:25,066 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:31:25,066 DEBUG [RS:0;jenkins-hbase20:38715] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:25,066 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38715,1689186684627' 2023-07-12 18:31:25,066 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/flush-table-proc/abort' 2023-07-12 18:31:25,066 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/flush-table-proc/acquired' 2023-07-12 18:31:25,067 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:31:25,067 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:31:25,067 DEBUG [RS:0;jenkins-hbase20:38715] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:25,067 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38715,1689186684627' 2023-07-12 18:31:25,067 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/online-snapshot/abort' 2023-07-12 18:31:25,067 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/online-snapshot/acquired' 2023-07-12 18:31:25,067 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:31:25,067 INFO [RS:0;jenkins-hbase20:38715] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:31:25,067 INFO [RS:0;jenkins-hbase20:38715] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:31:25,094 DEBUG [jenkins-hbase20:41187] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-12 18:31:25,095 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38715,1689186684627, state=OPENING 2023-07-12 18:31:25,096 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/2/meta-region-server 2023-07-12 18:31:25,096 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /2/meta-region-server: CHANGED 2023-07-12 18:31:25,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38715,1689186684627}] 2023-07-12 18:31:25,170 INFO [RS:0;jenkins-hbase20:38715] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38715%2C1689186684627, suffix=, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,38715,1689186684627, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs, maxLogs=10 2023-07-12 18:31:25,213 DEBUG [RS-EventLoopGroup-12-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK] 2023-07-12 18:31:25,214 DEBUG [RS-EventLoopGroup-12-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK] 2023-07-12 18:31:25,215 DEBUG [RS-EventLoopGroup-12-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK] 2023-07-12 18:31:25,219 INFO [RS:0;jenkins-hbase20:38715] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,38715,1689186684627/jenkins-hbase20.apache.org%2C38715%2C1689186684627.1689186685171 2023-07-12 18:31:25,220 DEBUG [RS:0;jenkins-hbase20:38715] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK], DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK], DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK]] 2023-07-12 18:31:25,250 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:25,251 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:25,252 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:31:25,257 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 18:31:25,257 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:25,259 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38715%2C1689186684627.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,38715,1689186684627, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs, maxLogs=10 2023-07-12 18:31:25,278 DEBUG [RS-EventLoopGroup-12-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK] 2023-07-12 18:31:25,279 DEBUG [RS-EventLoopGroup-12-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK] 2023-07-12 18:31:25,279 DEBUG [RS-EventLoopGroup-12-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK] 2023-07-12 18:31:25,308 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,38715,1689186684627/jenkins-hbase20.apache.org%2C38715%2C1689186684627.meta.1689186685260.meta 2023-07-12 18:31:25,309 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK], DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK], DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK]] 2023-07-12 18:31:25,309 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:25,310 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 18:31:25,310 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 18:31:25,311 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 18:31:25,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 18:31:25,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:25,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 18:31:25,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 18:31:25,316 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 18:31:25,319 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info 2023-07-12 18:31:25,320 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info 2023-07-12 18:31:25,320 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 18:31:25,334 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info/713a0feaf4e4481298e78a8b6112e9f1 2023-07-12 18:31:25,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:25,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 18:31:25,336 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:25,342 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:25,343 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 18:31:25,344 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:25,344 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 18:31:25,345 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/table 2023-07-12 18:31:25,345 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/table 2023-07-12 18:31:25,347 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 18:31:25,372 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/table/d68a2991dfeb4319a19d0b56203be4d4 2023-07-12 18:31:25,372 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:25,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740 2023-07-12 18:31:25,375 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740 2023-07-12 18:31:25,379 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 18:31:25,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 18:31:25,386 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=23; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63577603, jitterRate=-0.05261988937854767}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 18:31:25,387 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 18:31:25,388 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=20, masterSystemTime=1689186685250 2023-07-12 18:31:25,396 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 18:31:25,398 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 18:31:25,399 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38715,1689186684627, state=OPEN 2023-07-12 18:31:25,400 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/2/meta-region-server 2023-07-12 18:31:25,400 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /2/meta-region-server: CHANGED 2023-07-12 18:31:25,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-12 18:31:25,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38715,1689186684627 in 308 msec 2023-07-12 18:31:25,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=16 2023-07-12 18:31:25,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=16, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 472 msec 2023-07-12 18:31:26,531 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=1; waited=1604ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=1504ms 2023-07-12 18:31:28,034 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=1; waited=3107ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=3007ms 2023-07-12 18:31:29,438 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=4511ms, expected min=1 server(s), max=NO_LIMIT server(s), master is running 2023-07-12 18:31:29,438 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 18:31:29,446 DEBUG [hconnection-0x28633cb0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:29,447 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60354, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:29,458 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=63272e89b8aafccb1ffb2f93ed48b12c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,34413,1689186676157, regionLocation=jenkins-hbase20.apache.org,34413,1689186676157, openSeqNum=2 2023-07-12 18:31:29,458 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=e22f590dd8a98a0fba12251b93336902, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,34681,1689186676059, regionLocation=jenkins-hbase20.apache.org,34681,1689186676059, openSeqNum=2 2023-07-12 18:31:29,458 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=bde3b0e33054f5210b7a78be27604e3f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,41549,1689186676122, regionLocation=jenkins-hbase20.apache.org,41549,1689186676122, openSeqNum=2 2023-07-12 18:31:29,458 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-12 18:31:29,458 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689186749458 2023-07-12 18:31:29,458 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689186809458 2023-07-12 18:31:29,458 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 20 msec 2023-07-12 18:31:29,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41187,1689186684595-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:29,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41187,1689186684595-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:29,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41187,1689186684595-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:29,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:41187, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:29,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:29,483 INFO [PEWorker-4] procedure.ServerCrashProcedure(199): jenkins-hbase20.apache.org,42439,1689186676093 had 1 regions 2023-07-12 18:31:29,483 INFO [PEWorker-1] procedure.ServerCrashProcedure(199): jenkins-hbase20.apache.org,34413,1689186676157 had 1 regions 2023-07-12 18:31:29,483 INFO [PEWorker-2] procedure.ServerCrashProcedure(199): jenkins-hbase20.apache.org,41549,1689186676122 had 1 regions 2023-07-12 18:31:29,483 INFO [PEWorker-3] procedure.ServerCrashProcedure(199): jenkins-hbase20.apache.org,34681,1689186676059 had 1 regions 2023-07-12 18:31:29,483 WARN [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1240): hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. is NOT online; state={63272e89b8aafccb1ffb2f93ed48b12c state=OPEN, ts=1689186689458, server=jenkins-hbase20.apache.org,34413,1689186676157}; ServerCrashProcedures=true. Master startup cannot progress, in holding-pattern until region onlined. 2023-07-12 18:31:29,484 INFO [PEWorker-3] procedure.ServerCrashProcedure(300): Splitting WALs pid=15, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,34681,1689186676059, splitWal=true, meta=false, isMeta: false 2023-07-12 18:31:29,485 INFO [PEWorker-4] procedure.ServerCrashProcedure(300): Splitting WALs pid=16, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,42439,1689186676093, splitWal=true, meta=true, isMeta: false 2023-07-12 18:31:29,484 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=18, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,34413,1689186676157, splitWal=true, meta=false, isMeta: false 2023-07-12 18:31:29,484 INFO [PEWorker-2] procedure.ServerCrashProcedure(300): Splitting WALs pid=17, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,41549,1689186676122, splitWal=true, meta=false, isMeta: false 2023-07-12 18:31:29,487 DEBUG [PEWorker-3] master.MasterWalManager(318): Renamed region directory: hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34681,1689186676059-splitting 2023-07-12 18:31:29,488 INFO [PEWorker-3] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34681,1689186676059-splitting dir is empty, no logs to split. 2023-07-12 18:31:29,488 INFO [PEWorker-3] master.SplitWALManager(106): jenkins-hbase20.apache.org,34681,1689186676059 WAL count=0, meta=false 2023-07-12 18:31:29,489 DEBUG [PEWorker-1] master.MasterWalManager(318): Renamed region directory: hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34413,1689186676157-splitting 2023-07-12 18:31:29,489 INFO [PEWorker-4] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,42439,1689186676093-splitting dir is empty, no logs to split. 2023-07-12 18:31:29,490 INFO [PEWorker-4] master.SplitWALManager(106): jenkins-hbase20.apache.org,42439,1689186676093 WAL count=0, meta=false 2023-07-12 18:31:29,490 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34413,1689186676157-splitting dir is empty, no logs to split. 2023-07-12 18:31:29,490 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,34413,1689186676157 WAL count=0, meta=false 2023-07-12 18:31:29,490 DEBUG [PEWorker-2] master.MasterWalManager(318): Renamed region directory: hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,41549,1689186676122-splitting 2023-07-12 18:31:29,491 WARN [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(172): unknown_server=jenkins-hbase20.apache.org,34413,1689186676157/hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c., unknown_server=jenkins-hbase20.apache.org,34681,1689186676059/t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902., unknown_server=jenkins-hbase20.apache.org,41549,1689186676122/t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:29,492 INFO [PEWorker-2] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,41549,1689186676122-splitting dir is empty, no logs to split. 2023-07-12 18:31:29,492 INFO [PEWorker-2] master.SplitWALManager(106): jenkins-hbase20.apache.org,41549,1689186676122 WAL count=0, meta=false 2023-07-12 18:31:29,492 INFO [PEWorker-3] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34681,1689186676059-splitting dir is empty, no logs to split. 2023-07-12 18:31:29,492 INFO [PEWorker-3] master.SplitWALManager(106): jenkins-hbase20.apache.org,34681,1689186676059 WAL count=0, meta=false 2023-07-12 18:31:29,492 DEBUG [PEWorker-3] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,34681,1689186676059 WAL splitting is done? wals=0, meta=false 2023-07-12 18:31:29,493 INFO [PEWorker-4] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,42439,1689186676093-splitting dir is empty, no logs to split. 2023-07-12 18:31:29,493 INFO [PEWorker-4] master.SplitWALManager(106): jenkins-hbase20.apache.org,42439,1689186676093 WAL count=0, meta=false 2023-07-12 18:31:29,493 DEBUG [PEWorker-4] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,42439,1689186676093 WAL splitting is done? wals=0, meta=false 2023-07-12 18:31:29,494 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34413,1689186676157-splitting dir is empty, no logs to split. 2023-07-12 18:31:29,494 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,34413,1689186676157 WAL count=0, meta=false 2023-07-12 18:31:29,494 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,34413,1689186676157 WAL splitting is done? wals=0, meta=false 2023-07-12 18:31:29,495 INFO [PEWorker-2] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,41549,1689186676122-splitting dir is empty, no logs to split. 2023-07-12 18:31:29,495 INFO [PEWorker-2] master.SplitWALManager(106): jenkins-hbase20.apache.org,41549,1689186676122 WAL count=0, meta=false 2023-07-12 18:31:29,495 DEBUG [PEWorker-2] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,41549,1689186676122 WAL splitting is done? wals=0, meta=false 2023-07-12 18:31:29,495 INFO [PEWorker-3] procedure.ServerCrashProcedure(282): Remove WAL directory for jenkins-hbase20.apache.org,34681,1689186676059 failed, ignore...File hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34681,1689186676059-splitting does not exist. 2023-07-12 18:31:29,496 INFO [PEWorker-4] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase20.apache.org,42439,1689186676093 after splitting done 2023-07-12 18:31:29,496 DEBUG [PEWorker-4] master.DeadServer(114): Removed jenkins-hbase20.apache.org,42439,1689186676093 from processing; numProcessing=3 2023-07-12 18:31:29,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN}] 2023-07-12 18:31:29,497 INFO [PEWorker-1] procedure.ServerCrashProcedure(282): Remove WAL directory for jenkins-hbase20.apache.org,34413,1689186676157 failed, ignore...File hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,34413,1689186676157-splitting does not exist. 2023-07-12 18:31:29,498 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=21, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN 2023-07-12 18:31:29,498 INFO [PEWorker-2] procedure.ServerCrashProcedure(282): Remove WAL directory for jenkins-hbase20.apache.org,41549,1689186676122 failed, ignore...File hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,41549,1689186676122-splitting does not exist. 2023-07-12 18:31:29,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN}] 2023-07-12 18:31:29,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,42439,1689186676093, splitWal=true, meta=true in 4.6330 sec 2023-07-12 18:31:29,499 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=21, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:29,500 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN}] 2023-07-12 18:31:29,500 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN 2023-07-12 18:31:29,501 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=22, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:29,501 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=17, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN 2023-07-12 18:31:29,501 DEBUG [jenkins-hbase20:41187] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-12 18:31:29,503 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=e22f590dd8a98a0fba12251b93336902, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:29,503 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186689503"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186689503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186689503"}]},"ts":"1689186689503"} 2023-07-12 18:31:29,504 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=17, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:29,505 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=63272e89b8aafccb1ffb2f93ed48b12c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:29,506 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186689505"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186689505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186689505"}]},"ts":"1689186689505"} 2023-07-12 18:31:29,506 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=21, state=RUNNABLE; OpenRegionProcedure e22f590dd8a98a0fba12251b93336902, server=jenkins-hbase20.apache.org,38715,1689186684627}] 2023-07-12 18:31:29,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; OpenRegionProcedure 63272e89b8aafccb1ffb2f93ed48b12c, server=jenkins-hbase20.apache.org,38715,1689186684627}] 2023-07-12 18:31:29,655 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=bde3b0e33054f5210b7a78be27604e3f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:29,656 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186689655"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186689655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186689655"}]},"ts":"1689186689655"} 2023-07-12 18:31:29,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure bde3b0e33054f5210b7a78be27604e3f, server=jenkins-hbase20.apache.org,38715,1689186684627}] 2023-07-12 18:31:29,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:29,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e22f590dd8a98a0fba12251b93336902, NAME => 't1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:29,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table t1_syncup e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:29,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:29,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:29,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:29,665 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:29,666 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1 2023-07-12 18:31:29,666 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1 2023-07-12 18:31:29,666 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:29,666 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 63272e89b8aafccb1ffb2f93ed48b12c, NAME => 'hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:29,666 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e22f590dd8a98a0fba12251b93336902 columnFamilyName cf1 2023-07-12 18:31:29,666 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:29,666 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:29,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:29,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:29,668 INFO [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:29,669 DEBUG [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/info 2023-07-12 18:31:29,669 DEBUG [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/info 2023-07-12 18:31:29,669 INFO [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63272e89b8aafccb1ffb2f93ed48b12c columnFamilyName info 2023-07-12 18:31:29,673 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1/ca6edfd8870545488777f98352cb93e2 2023-07-12 18:31:29,673 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(310): Store=e22f590dd8a98a0fba12251b93336902/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:29,673 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family norep of region e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:29,674 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/norep 2023-07-12 18:31:29,674 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/norep 2023-07-12 18:31:29,675 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e22f590dd8a98a0fba12251b93336902 columnFamilyName norep 2023-07-12 18:31:29,675 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(310): Store=e22f590dd8a98a0fba12251b93336902/norep, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:29,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:29,677 DEBUG [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/info/1d076a2957f24c2c974ca0e26f8c2633 2023-07-12 18:31:29,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:29,678 INFO [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] regionserver.HStore(310): Store=63272e89b8aafccb1ffb2f93ed48b12c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:29,679 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:29,680 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:29,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table t1_syncup descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 18:31:29,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:29,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e22f590dd8a98a0fba12251b93336902; next sequenceid=11; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73891929, jitterRate=0.10107554495334625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 18:31:29,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e22f590dd8a98a0fba12251b93336902: 2023-07-12 18:31:29,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902., pid=24, masterSystemTime=1689186689658 2023-07-12 18:31:29,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:29,685 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 63272e89b8aafccb1ffb2f93ed48b12c; next sequenceid=10; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73536428, jitterRate=0.09577816724777222}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:31:29,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 63272e89b8aafccb1ffb2f93ed48b12c: 2023-07-12 18:31:29,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:29,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:29,686 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c., pid=25, masterSystemTime=1689186689658 2023-07-12 18:31:29,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:29,690 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=e22f590dd8a98a0fba12251b93336902, regionState=OPEN, openSeqNum=11, regionLocation=jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:29,690 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:29,690 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186689690"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186689690"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186689690"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186689690"}]},"ts":"1689186689690"} 2023-07-12 18:31:29,690 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=63272e89b8aafccb1ffb2f93ed48b12c, regionState=OPEN, openSeqNum=10, regionLocation=jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:29,691 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186689690"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186689690"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186689690"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186689690"}]},"ts":"1689186689690"} 2023-07-12 18:31:29,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=21 2023-07-12 18:31:29,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=21, state=SUCCESS; OpenRegionProcedure e22f590dd8a98a0fba12251b93336902, server=jenkins-hbase20.apache.org,38715,1689186684627 in 186 msec 2023-07-12 18:31:29,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-12 18:31:29,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; OpenRegionProcedure 63272e89b8aafccb1ffb2f93ed48b12c, server=jenkins-hbase20.apache.org,38715,1689186684627 in 186 msec 2023-07-12 18:31:29,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-07-12 18:31:29,696 INFO [PEWorker-3] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase20.apache.org,34681,1689186676059 after splitting done 2023-07-12 18:31:29,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN in 198 msec 2023-07-12 18:31:29,696 DEBUG [PEWorker-3] master.DeadServer(114): Removed jenkins-hbase20.apache.org,34681,1689186676059 from processing; numProcessing=2 2023-07-12 18:31:29,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-07-12 18:31:29,696 INFO [PEWorker-1] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase20.apache.org,34413,1689186676157 after splitting done 2023-07-12 18:31:29,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN in 195 msec 2023-07-12 18:31:29,696 DEBUG [PEWorker-1] master.DeadServer(114): Removed jenkins-hbase20.apache.org,34413,1689186676157 from processing; numProcessing=1 2023-07-12 18:31:29,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,34681,1689186676059, splitWal=true, meta=false in 4.8480 sec 2023-07-12 18:31:29,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,34413,1689186676157, splitWal=true, meta=false in 4.8300 sec 2023-07-12 18:31:29,798 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 18:31:29,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:29,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bde3b0e33054f5210b7a78be27604e3f, NAME => 't2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:29,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table t2_syncup bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:29,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:29,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:29,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:29,817 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:29,818 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1 2023-07-12 18:31:29,818 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1 2023-07-12 18:31:29,819 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bde3b0e33054f5210b7a78be27604e3f columnFamilyName cf1 2023-07-12 18:31:29,828 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1/3a4b74c213ec46f7865410bb78e1144c 2023-07-12 18:31:29,829 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(310): Store=bde3b0e33054f5210b7a78be27604e3f/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:29,829 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family norep of region bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:29,831 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/norep 2023-07-12 18:31:29,831 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/norep 2023-07-12 18:31:29,831 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bde3b0e33054f5210b7a78be27604e3f columnFamilyName norep 2023-07-12 18:31:29,832 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(310): Store=bde3b0e33054f5210b7a78be27604e3f/norep, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:29,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:29,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:29,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table t2_syncup descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 18:31:29,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:29,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bde3b0e33054f5210b7a78be27604e3f; next sequenceid=12; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58771120, jitterRate=-0.12424206733703613}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 18:31:29,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bde3b0e33054f5210b7a78be27604e3f: 2023-07-12 18:31:29,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f., pid=26, masterSystemTime=1689186689809 2023-07-12 18:31:29,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:29,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:29,841 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=bde3b0e33054f5210b7a78be27604e3f, regionState=OPEN, openSeqNum=12, regionLocation=jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:29,841 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186689841"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186689841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186689841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186689841"}]},"ts":"1689186689841"} 2023-07-12 18:31:29,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=23 2023-07-12 18:31:29,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure bde3b0e33054f5210b7a78be27604e3f, server=jenkins-hbase20.apache.org,38715,1689186684627 in 186 msec 2023-07-12 18:31:29,847 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-07-12 18:31:29,847 INFO [PEWorker-2] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase20.apache.org,41549,1689186676122 after splitting done 2023-07-12 18:31:29,847 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN in 345 msec 2023-07-12 18:31:29,847 DEBUG [PEWorker-2] master.DeadServer(114): Removed jenkins-hbase20.apache.org,41549,1689186676122 from processing; numProcessing=0 2023-07-12 18:31:29,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,41549,1689186676122, splitWal=true, meta=false in 4.9830 sec 2023-07-12 18:31:30,065 INFO [jenkins-hbase20:38715Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:30,484 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/namespace 2023-07-12 18:31:30,503 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/2/namespace/default 2023-07-12 18:31:30,505 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/2/namespace/hbase 2023-07-12 18:31:30,505 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 5.843sec 2023-07-12 18:31:30,505 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 18:31:30,505 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 18:31:30,505 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 18:31:30,505 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41187,1689186684595-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 18:31:30,506 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41187,1689186684595-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 18:31:30,510 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 18:31:30,553 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(139): Connect 0x120b16c5 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:30,560 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22d658b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:30,563 DEBUG [hconnection-0x7f457ba4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:30,565 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:30,569 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(1262): HBase has been restarted 2023-07-12 18:31:30,570 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x120b16c5 to 127.0.0.1:64028 2023-07-12 18:31:30,570 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:30,572 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(2939): Invalidated connection. Updating master addresses before: jenkins-hbase20.apache.org:41187 after: jenkins-hbase20.apache.org:41187 2023-07-12 18:31:30,572 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(139): Connect 0x155f3e64 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:30,581 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4193ef30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:31,019 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 't2_syncup' 2023-07-12 18:31:31,020 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 18:31:31,021 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 18:31:31,022 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 't1_syncup' 2023-07-12 18:31:31,085 DEBUG [hconnection-0x545107aa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:31,088 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:31,120 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=syncupReplication1689186691120 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:31,124 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): syncupReplication16891866911200x0, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:31,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): syncupReplication1689186691120-0x1008273886f0023 connected Start Replication Server start 2023-07-12 18:31:31,127 INFO [Listener at localhost.localdomain/40201] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:31,139 INFO [Listener at localhost.localdomain/40201] hbase.HBaseConfiguration(293): Overriding client registry implementation to org.apache.hadoop.hbase.client.ZKConnectionRegistry 2023-07-12 18:31:31,141 DEBUG [Listener at localhost.localdomain/40201] regionserver.Replication(139): Replication stats-in-log period=5 seconds 2023-07-12 18:31:31,150 INFO [Listener at localhost.localdomain/40201] regionserver.ReplicationSource(232): queueId=1, ReplicationSource: 1, currentBandwidth=0 2023-07-12 18:31:31,151 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager(266): Current list of replicators: [jenkins-hbase20.apache.org,40805,1689186672112, jenkins-hbase20.apache.org,37271,1689186672154] other RSs: [] 2023-07-12 18:31:31,168 DEBUG [Listener at localhost.localdomain/40201.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x3aeb917d to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:31,173 DEBUG [Listener at localhost.localdomain/40201.replicationSource,1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@3dfe002a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:31,174 INFO [Listener at localhost.localdomain/40201.replicationSource,1] zookeeper.RecoverableZooKeeper(93): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:31,177 DEBUG [Listener at localhost.localdomain/40201.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 10x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:31,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): connection to cluster: 1-0x1008273886f0025 connected 2023-07-12 18:31:31,178 INFO [Listener at localhost.localdomain/40201.replicationSource,1] regionserver.ReplicationSource(586): peerId=1, queueId=1 (queues=0) is replicating from cluster=23c3b538-bf67-481b-8351-f0e7ae087693 to cluster=3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:33,304 INFO [ReplicationExecutor-0] replication.ZKReplicationQueueStorage(390): Atomically moving jenkins-hbase20.apache.org,40805,1689186672112/1's WALs to 1689186691127.syncuptool.replication.org,1234,1 2023-07-12 18:31:33,306 DEBUG [ReplicationExecutor-0] replication.ZKReplicationQueueStorage(415): Creating jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708 with data PBUF\x08\xF9\xA9\x01 2023-07-12 18:31:33,308 INFO [ReplicationExecutor-0] replication.ZKReplicationQueueStorage(433): Atomically moved jenkins-hbase20.apache.org,40805,1689186672112/1's WALs to 1689186691127.syncuptool.replication.org,1234,1 2023-07-12 18:31:35,065 INFO [jenkins-hbase20:38715Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:35,167 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 18:31:35,309 DEBUG [ReplicationExecutor-0] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,40805,1689186672112] 2023-07-12 18:31:35,309 DEBUG [ReplicationExecutor-0] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,40805,1689186672112] 2023-07-12 18:31:35,328 DEBUG [ReplicationExecutor-0] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,40805,1689186672112] 2023-07-12 18:31:35,328 INFO [ReplicationExecutor-0] regionserver.ReplicationSource(232): queueId=1-jenkins-hbase20.apache.org,40805,1689186672112, ReplicationSource: 1, currentBandwidth=0 2023-07-12 18:31:35,328 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager$NodeFailoverWorker(800): Added recovered source 1-jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:35,358 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112] zookeeper.ReadOnlyZKClient(139): Connect 0x34bfb220 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:35,377 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@377b0b6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:35,377 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112] zookeeper.RecoverableZooKeeper(93): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:35,388 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 10x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:35,389 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.ReplicationSource(586): peerId=1, queueId=1-jenkins-hbase20.apache.org,40805,1689186672112 (queues=1) is replicating from cluster=23c3b538-bf67-481b-8351-f0e7ae087693 to cluster=3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:35,389 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.ReplicationSource(346): peerId=1, starting shipping worker for walGroupId=jenkins-hbase20.apache.org%2C40805%2C1689186672112 2023-07-12 18:31:35,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): connection to cluster: 1-0x1008273886f0027 connected 2023-07-12 18:31:35,402 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.ReplicationSourceWALReader(119): peerClusterZnode=1-jenkins-hbase20.apache.org,40805,1689186672112, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2023-07-12 18:31:35,403 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.ReplicationSourceShipper(98): Running ReplicationSourceShipper Thread for wal group: jenkins-hbase20.apache.org%2C40805%2C1689186672112 2023-07-12 18:31:35,415 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.WALEntryStream(248): EOF, closing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708 2023-07-12 18:31:35,415 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.ReplicationSourceWALReader(162): Read 1 WAL entries eligible for replication 2023-07-12 18:31:35,416 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C40805%2C1689186672112,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.ReplicationSourceWALReader(247): Stopping the replication source wal reader 2023-07-12 18:31:35,417 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.ReplicationSourceShipper(110): Shipper from source 1-jenkins-hbase20.apache.org,40805,1689186672112 got entry batch from reader: WALEntryBatch [walEntries=[{t2_syncup/93e6956722d05ec4972c3a5270b9ac18/205=[#edits: 100 = ],8120}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs/jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708, lastWalPosition=29260, nbRowKeys=100, nbHFiles=0, heapSize=8120, lastSeqIds={}, endOfFile=true,usedBufferSize=8120] 2023-07-12 18:31:35,421 DEBUG [SinkThread-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:35,425 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:31:35,428 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=38715] regionserver.ReplicationSink(263): Started replicating mutations. 2023-07-12 18:31:35,428 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=38715] zookeeper.ReadOnlyZKClient(139): Connect 0x618bd7ea to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:35,434 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=38715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@6f4c35ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:35,441 DEBUG [hconnection-0x6b73bc9a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:35,443 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=ClientService 2023-07-12 18:31:35,475 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=38715] regionserver.ReplicationSink(267): Finished replicating mutations. 2023-07-12 18:31:35,475 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1-jenkins-hbase20.apache.org,40805,1689186672112] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,40805,1689186672112] 2023-07-12 18:31:35,476 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.ReplicationSourceManager(580): Removing 1 logs in the list: [jenkins-hbase20.apache.org%2C40805%2C1689186672112.1689186673708] 2023-07-12 18:31:35,478 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.ReplicationSourceShipper(110): Shipper from source 1-jenkins-hbase20.apache.org,40805,1689186672112 got entry batch from reader: WALEntryBatch [walEntries=[], lastWalPath=null, lastWalPosition=0, nbRowKeys=0, nbHFiles=0, heapSize=0, lastSeqIds={}, endOfFile=false,usedBufferSize=0] 2023-07-12 18:31:35,478 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.RecoveredReplicationSourceShipper(50): Finished recovering queue for group jenkins-hbase20.apache.org%2C40805%2C1689186672112 of peer 1-jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:35,579 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.ReplicationSourceManager(453): Done with the recovered queue 1-jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:35,581 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): syncupReplication1689186691120-0x1008273886f0023, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/replication/rs/1689186691127.syncuptool.replication.org,1234,1/1-jenkins-hbase20.apache.org,40805,1689186672112 2023-07-12 18:31:35,582 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112.replicationSource.shipperjenkins-hbase20.apache.org%2C40805%2C1689186672112,1-jenkins-hbase20.apache.org,40805,1689186672112] regionserver.RecoveredReplicationSource(153): Finished recovering queue 1-jenkins-hbase20.apache.org,40805,1689186672112 with the following stats: Total replicated edits: 1, current progress: 2023-07-12 18:31:38,657 INFO [ReplicationExecutor-0] replication.ZKReplicationQueueStorage(390): Atomically moving jenkins-hbase20.apache.org,37271,1689186672154/1's WALs to 1689186691127.syncuptool.replication.org,1234,1 2023-07-12 18:31:38,660 DEBUG [ReplicationExecutor-0] replication.ZKReplicationQueueStorage(415): Creating jenkins-hbase20.apache.org%2C37271%2C1689186672154.1689186673708 with data PBUF\x08\xE6Y 2023-07-12 18:31:38,662 INFO [ReplicationExecutor-0] replication.ZKReplicationQueueStorage(433): Atomically moved jenkins-hbase20.apache.org,37271,1689186672154/1's WALs to 1689186691127.syncuptool.replication.org,1234,1 2023-07-12 18:31:40,065 INFO [jenkins-hbase20:38715Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:40,065 INFO [jenkins-hbase20:38715Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2023-07-12 18:31:40,663 DEBUG [ReplicationExecutor-0] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,37271,1689186672154] 2023-07-12 18:31:40,664 DEBUG [ReplicationExecutor-0] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,37271,1689186672154] 2023-07-12 18:31:40,679 DEBUG [ReplicationExecutor-0] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,37271,1689186672154] 2023-07-12 18:31:40,679 INFO [ReplicationExecutor-0] regionserver.ReplicationSource(232): queueId=1-jenkins-hbase20.apache.org,37271,1689186672154, ReplicationSource: 1, currentBandwidth=0 2023-07-12 18:31:40,679 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager$NodeFailoverWorker(800): Added recovered source 1-jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:40,707 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154] zookeeper.ReadOnlyZKClient(139): Connect 0x23e9f535 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:40,711 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@2dc79e19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:40,712 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154] zookeeper.RecoverableZooKeeper(93): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:40,714 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 10x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:40,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): connection to cluster: 1-0x1008273886f002a connected 2023-07-12 18:31:40,716 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.ReplicationSource(586): peerId=1, queueId=1-jenkins-hbase20.apache.org,37271,1689186672154 (queues=1) is replicating from cluster=23c3b538-bf67-481b-8351-f0e7ae087693 to cluster=3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:40,716 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.ReplicationSource(346): peerId=1, starting shipping worker for walGroupId=jenkins-hbase20.apache.org%2C37271%2C1689186672154 2023-07-12 18:31:40,717 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.ReplicationSourceWALReader(119): peerClusterZnode=1-jenkins-hbase20.apache.org,37271,1689186672154, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2023-07-12 18:31:40,720 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.ReplicationSourceShipper(98): Running ReplicationSourceShipper Thread for wal group: jenkins-hbase20.apache.org%2C37271%2C1689186672154 2023-07-12 18:31:40,729 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.WALEntryStream(248): EOF, closing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs/jenkins-hbase20.apache.org%2C37271%2C1689186672154.1689186673708 2023-07-12 18:31:40,729 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.ReplicationSourceWALReader(162): Read 1 WAL entries eligible for replication 2023-07-12 18:31:40,730 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C37271%2C1689186672154,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.ReplicationSourceWALReader(247): Stopping the replication source wal reader 2023-07-12 18:31:40,731 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.ReplicationSourceShipper(110): Shipper from source 1-jenkins-hbase20.apache.org,37271,1689186672154 got entry batch from reader: WALEntryBatch [walEntries=[{t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/105=[#edits: 50 = ],4120}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs/jenkins-hbase20.apache.org%2C37271%2C1689186672154.1689186673708, lastWalPosition=16524, nbRowKeys=50, nbHFiles=0, heapSize=4120, lastSeqIds={}, endOfFile=true,usedBufferSize=4120] 2023-07-12 18:31:40,736 DEBUG [SinkThread-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:40,738 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:31:40,738 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=38715] regionserver.ReplicationSink(263): Started replicating mutations. 2023-07-12 18:31:40,750 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=38715] regionserver.ReplicationSink(267): Finished replicating mutations. 2023-07-12 18:31:40,750 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1-jenkins-hbase20.apache.org,37271,1689186672154] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,37271,1689186672154] 2023-07-12 18:31:40,751 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.ReplicationSourceManager(580): Removing 1 logs in the list: [jenkins-hbase20.apache.org%2C37271%2C1689186672154.1689186673708] 2023-07-12 18:31:40,752 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.ReplicationSourceShipper(110): Shipper from source 1-jenkins-hbase20.apache.org,37271,1689186672154 got entry batch from reader: WALEntryBatch [walEntries=[], lastWalPath=null, lastWalPosition=0, nbRowKeys=0, nbHFiles=0, heapSize=0, lastSeqIds={}, endOfFile=false,usedBufferSize=0] 2023-07-12 18:31:40,752 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.RecoveredReplicationSourceShipper(50): Finished recovering queue for group jenkins-hbase20.apache.org%2C37271%2C1689186672154 of peer 1-jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:40,853 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.ReplicationSourceManager(453): Done with the recovered queue 1-jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:40,855 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): syncupReplication1689186691120-0x1008273886f0023, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/replication/rs/1689186691127.syncuptool.replication.org,1234,1/1-jenkins-hbase20.apache.org,37271,1689186672154 2023-07-12 18:31:40,855 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154.replicationSource.shipperjenkins-hbase20.apache.org%2C37271%2C1689186672154,1-jenkins-hbase20.apache.org,37271,1689186672154] regionserver.RecoveredReplicationSource(153): Finished recovering queue 1-jenkins-hbase20.apache.org,37271,1689186672154 with the following stats: Total replicated edits: 1, current progress: 2023-07-12 18:31:41,082 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 18:31:41,156 INFO [Listener at localhost.localdomain/40201] regionserver.ReplicationSource(656): peerId=1, Closing source 1 because: Region server is closing 2023-07-12 18:31:41,263 DEBUG [Listener at localhost.localdomain/40201.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0025, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:41,263 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aeb917d to 127.0.0.1:64028 2023-07-12 18:31:41,265 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:41,467 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): syncupReplication1689186691120-0x1008273886f0023, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:41,467 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): syncupReplication1689186691120-0x1008273886f0023, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:41,485 INFO [Listener at localhost.localdomain/40201] replication.TestReplicationSyncUpTool(203): SyncUpAfterDelete succeeded at retry = 0 2023-07-12 18:31:41,485 DEBUG [Listener at localhost.localdomain/40201] replication.TestReplicationSyncUpTool(215): mimicSyncUpAfterPut 2023-07-12 18:31:41,487 INFO [Listener at localhost.localdomain/40201] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 18:31:41,488 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:41,488 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:41,488 INFO [Listener at localhost.localdomain/40201] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:41,488 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:41,488 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:41,488 INFO [Listener at localhost.localdomain/40201] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:41,489 INFO [Listener at localhost.localdomain/40201] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36461 2023-07-12 18:31:41,490 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:41,491 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:41,493 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36461 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:41,498 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:364610x0, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:41,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36461-0x1008273886f002b connected 2023-07-12 18:31:41,506 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/master 2023-07-12 18:31:41,507 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/running 2023-07-12 18:31:41,507 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/acl 2023-07-12 18:31:41,511 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36461 2023-07-12 18:31:41,511 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36461 2023-07-12 18:31:41,511 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36461 2023-07-12 18:31:41,518 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36461 2023-07-12 18:31:41,522 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36461 2023-07-12 18:31:41,523 INFO [Listener at localhost.localdomain/40201] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347, hbase.cluster.distributed=false 2023-07-12 18:31:41,535 DEBUG [pool-543-thread-1] master.MetaRegionLocationCache(164): Updating meta znode for path /1/meta-region-server: INIT 2023-07-12 18:31:41,549 INFO [Listener at localhost.localdomain/40201] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 18:31:41,549 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:41,550 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:41,550 INFO [Listener at localhost.localdomain/40201] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:41,550 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:41,550 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:41,550 INFO [Listener at localhost.localdomain/40201] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:41,551 INFO [Listener at localhost.localdomain/40201] ipc.NettyRpcServer(120): Bind to /148.251.75.209:39045 2023-07-12 18:31:41,552 INFO [Listener at localhost.localdomain/40201] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:31:41,554 DEBUG [Listener at localhost.localdomain/40201] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:31:41,554 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:41,556 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:41,557 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39045 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:41,561 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:390450x0, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:41,563 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:390450x0, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/master 2023-07-12 18:31:41,564 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:390450x0, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/running 2023-07-12 18:31:41,565 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:390450x0, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/acl 2023-07-12 18:31:41,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39045-0x1008273886f002c connected 2023-07-12 18:31:41,574 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39045 2023-07-12 18:31:41,575 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39045 2023-07-12 18:31:41,575 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39045 2023-07-12 18:31:41,576 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39045 2023-07-12 18:31:41,576 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39045 2023-07-12 18:31:41,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /1/backup-masters/jenkins-hbase20.apache.org,36461,1689186701487 2023-07-12 18:31:41,581 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/backup-masters 2023-07-12 18:31:41,581 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/backup-masters/jenkins-hbase20.apache.org,36461,1689186701487 2023-07-12 18:31:41,582 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1008273886f002c, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/1/master 2023-07-12 18:31:41,582 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/1/master 2023-07-12 18:31:41,582 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:41,582 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/master 2023-07-12 18:31:41,584 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /1/backup-masters/jenkins-hbase20.apache.org,36461,1689186701487 from backup master directory 2023-07-12 18:31:41,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/master 2023-07-12 18:31:41,585 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/backup-masters/jenkins-hbase20.apache.org,36461,1689186701487 2023-07-12 18:31:41,585 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/backup-masters 2023-07-12 18:31:41,585 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:41,585 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,36461,1689186701487 2023-07-12 18:31:41,603 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:41,658 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6144d79e to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:41,665 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c11273c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:41,665 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:41,666 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 18:31:41,670 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:41,684 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(288): Renamed hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,40897,1689186671073 to hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,40897,1689186671073-dead as it is dead 2023-07-12 18:31:41,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,40897,1689186671073-dead/jenkins-hbase20.apache.org%2C40897%2C1689186671073.1689186672648 2023-07-12 18:31:41,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,40897,1689186671073-dead/jenkins-hbase20.apache.org%2C40897%2C1689186671073.1689186672648 after 2ms 2023-07-12 18:31:41,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(300): Renamed hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,40897,1689186671073-dead/jenkins-hbase20.apache.org%2C40897%2C1689186671073.1689186672648 to hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C40897%2C1689186671073.1689186672648 2023-07-12 18:31:41,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(302): Delete empty local region wal dir hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,40897,1689186671073-dead 2023-07-12 18:31:41,691 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,36461,1689186701487 2023-07-12 18:31:41,698 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36461%2C1689186701487, suffix=, logDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,36461,1689186701487, archiveDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/oldWALs, maxLogs=10 2023-07-12 18:31:41,719 DEBUG [RS-EventLoopGroup-15-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK] 2023-07-12 18:31:41,719 DEBUG [RS-EventLoopGroup-15-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK] 2023-07-12 18:31:41,725 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/WALs/jenkins-hbase20.apache.org,36461,1689186701487/jenkins-hbase20.apache.org%2C36461%2C1689186701487.1689186701699 2023-07-12 18:31:41,726 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK], DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK]] 2023-07-12 18:31:41,727 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:41,727 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:41,727 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:41,727 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:41,729 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:41,730 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 18:31:41,731 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 18:31:41,740 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3d808d4bb7e24b029519d570d3018423 2023-07-12 18:31:41,740 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:41,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5179): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals 2023-07-12 18:31:41,741 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C40897%2C1689186671073.1689186672648 2023-07-12 18:31:41,748 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5464): Applied 0, skipped 155, firstSequenceIdInLog=3, maxSequenceIdInLog=138, path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C40897%2C1689186671073.1689186672648 2023-07-12 18:31:41,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C40897%2C1689186671073.1689186672648 2023-07-12 18:31:41,752 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:41,756 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/138.seqid, newMaxSeqId=138, maxSeqId=1 2023-07-12 18:31:41,758 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=139; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71846848, jitterRate=0.0706014633178711}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:31:41,758 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:31:41,758 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 18:31:41,760 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 18:31:41,760 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 18:31:41,760 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 18:31:41,761 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 18:31:41,767 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 18:31:41,767 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 18:31:41,768 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 18:31:41,768 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 18:31:41,768 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=t1_syncup 2023-07-12 18:31:41,769 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=12, state=SUCCESS; CreateTableProcedure table=t2_syncup 2023-07-12 18:31:41,769 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=15, state=SUCCESS; org.apache.hadoop.hbase.master.replication.AddPeerProcedure 2023-07-12 18:31:41,770 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 8 msec 2023-07-12 18:31:41,770 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 18:31:41,771 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 18:31:41,771 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,37271,1689186672154, table=hbase:meta, region=1588230740 2023-07-12 18:31:41,773 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 2 possibly 'live' servers, and 0 'splitting'. 2023-07-12 18:31:41,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.RecoverableZooKeeper(172): Node /1/draining/jenkins-hbase20.apache.org,40805,1689186672112 already deleted, retry=false 2023-07-12 18:31:41,777 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(568): Processing expiration of jenkins-hbase20.apache.org,40805,1689186672112 on jenkins-hbase20.apache.org,36461,1689186701487 2023-07-12 18:31:41,778 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,40805,1689186672112, splitWal=true, meta=false 2023-07-12 18:31:41,778 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=18 for jenkins-hbase20.apache.org,40805,1689186672112 (carryingMeta=false) jenkins-hbase20.apache.org,40805,1689186672112/CRASHED/regionCount=0/lock=java.util.concurrent.locks.ReentrantReadWriteLock@3402053a[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-12 18:31:41,780 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.RecoverableZooKeeper(172): Node /1/draining/jenkins-hbase20.apache.org,37271,1689186672154 already deleted, retry=false 2023-07-12 18:31:41,780 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(568): Processing expiration of jenkins-hbase20.apache.org,37271,1689186672154 on jenkins-hbase20.apache.org,36461,1689186701487 2023-07-12 18:31:41,781 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,37271,1689186672154, splitWal=true, meta=true 2023-07-12 18:31:41,781 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=19 for jenkins-hbase20.apache.org,37271,1689186672154 (carryingMeta=true) jenkins-hbase20.apache.org,37271,1689186672154/CRASHED/regionCount=1/lock=java.util.concurrent.locks.ReentrantReadWriteLock@1521ebc1[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-12 18:31:41,791 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 18:31:41,792 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 18:31:41,792 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/balancer 2023-07-12 18:31:41,793 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 18:31:41,793 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/normalizer 2023-07-12 18:31:41,794 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/switch/split 2023-07-12 18:31:41,794 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/switch/merge 2023-07-12 18:31:41,797 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/snapshot-cleanup 2023-07-12 18:31:41,798 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/1/running 2023-07-12 18:31:41,798 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:41,798 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1008273886f002c, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/1/running 2023-07-12 18:31:41,799 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,36461,1689186701487, sessionid=0x1008273886f002b, setting cluster-up flag (Was=false) 2023-07-12 18:31:41,814 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /1/flush-table-proc/acquired, /1/flush-table-proc/reached, /1/flush-table-proc/abort 2023-07-12 18:31:41,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36461,1689186701487 2023-07-12 18:31:41,817 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /1/online-snapshot/acquired, /1/online-snapshot/reached, /1/online-snapshot/abort 2023-07-12 18:31:41,818 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36461,1689186701487 2023-07-12 18:31:41,818 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/.hbase-snapshot/.tmp 2023-07-12 18:31:41,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:41,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:41,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:41,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:41,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-07-12 18:31:41,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:41,821 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:41,821 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:41,832 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689186731832 2023-07-12 18:31:41,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 18:31:41,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 18:31:41,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 18:31:41,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 18:31:41,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 18:31:41,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 18:31:41,854 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:41,856 DEBUG [PEWorker-2] master.DeadServer(103): Processing jenkins-hbase20.apache.org,40805,1689186672112; numProcessing=1 2023-07-12 18:31:41,856 DEBUG [PEWorker-1] master.DeadServer(103): Processing jenkins-hbase20.apache.org,37271,1689186672154; numProcessing=2 2023-07-12 18:31:41,856 INFO [PEWorker-2] procedure.ServerCrashProcedure(161): Start pid=18, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,40805,1689186672112, splitWal=true, meta=false 2023-07-12 18:31:41,856 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=19, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,37271,1689186672154, splitWal=true, meta=true 2023-07-12 18:31:41,856 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 18:31:41,856 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 18:31:41,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 18:31:41,857 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=19, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,37271,1689186672154, splitWal=true, meta=true, isMeta: true 2023-07-12 18:31:41,860 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 18:31:41,860 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 18:31:41,860 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186701860,5,FailOnTimeoutGroup] 2023-07-12 18:31:41,860 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186701860,5,FailOnTimeoutGroup] 2023-07-12 18:31:41,860 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:41,861 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 18:31:41,861 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:41,861 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:41,861 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689186701861, completionTime=-1 2023-07-12 18:31:41,861 WARN [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(766): The value of 'hbase.master.wait.on.regionservers.maxtostart' (-1) is set less than 'hbase.master.wait.on.regionservers.mintostart' (1), ignoring. 2023-07-12 18:31:41,861 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=0; waited=0ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=0ms 2023-07-12 18:31:41,861 DEBUG [PEWorker-1] master.MasterWalManager(318): Renamed region directory: hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154-splitting 2023-07-12 18:31:41,862 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154-splitting dir is empty, no logs to split. 2023-07-12 18:31:41,863 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,37271,1689186672154 WAL count=0, meta=true 2023-07-12 18:31:41,866 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154-splitting dir is empty, no logs to split. 2023-07-12 18:31:41,866 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,37271,1689186672154 WAL count=0, meta=true 2023-07-12 18:31:41,866 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,37271,1689186672154 WAL splitting is done? wals=0, meta=true 2023-07-12 18:31:41,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 18:31:41,872 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 18:31:41,879 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:41,880 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(951): ClusterId : 23c3b538-bf67-481b-8351-f0e7ae087693 2023-07-12 18:31:41,881 DEBUG [RS:0;jenkins-hbase20:39045] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:31:41,884 DEBUG [RS:0;jenkins-hbase20:39045] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:31:41,884 DEBUG [RS:0;jenkins-hbase20:39045] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:31:41,889 DEBUG [RS:0;jenkins-hbase20:39045] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:31:41,892 DEBUG [RS:0;jenkins-hbase20:39045] zookeeper.ReadOnlyZKClient(139): Connect 0x197ca5b7 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:41,901 DEBUG [RS:0;jenkins-hbase20:39045] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17bb48e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:41,901 DEBUG [RS:0;jenkins-hbase20:39045] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1384cec7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:41,912 DEBUG [RS:0;jenkins-hbase20:39045] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:39045 2023-07-12 18:31:41,912 INFO [RS:0;jenkins-hbase20:39045] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:31:41,912 INFO [RS:0;jenkins-hbase20:39045] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:31:41,912 DEBUG [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:31:41,913 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36461,1689186701487 with isa=jenkins-hbase20.apache.org/148.251.75.209:39045, startcode=1689186701549 2023-07-12 18:31:41,913 DEBUG [RS:0;jenkins-hbase20:39045] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:31:41,915 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34579, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:31:41,916 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36461] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:41,917 DEBUG [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347 2023-07-12 18:31:41,917 DEBUG [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:33763 2023-07-12 18:31:41,917 DEBUG [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:31:41,918 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/rs 2023-07-12 18:31:41,919 DEBUG [RS:0;jenkins-hbase20:39045] zookeeper.ZKUtil(162): regionserver:39045-0x1008273886f002c, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/rs/jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:41,919 WARN [RS:0;jenkins-hbase20:39045] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:41,920 INFO [RS:0;jenkins-hbase20:39045] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:41,920 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,39045,1689186701549] 2023-07-12 18:31:41,920 DEBUG [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:41,934 INFO [RS:0;jenkins-hbase20:39045] hbase.HBaseConfiguration(293): Overriding client registry implementation to org.apache.hadoop.hbase.client.ZKConnectionRegistry 2023-07-12 18:31:41,935 DEBUG [RS:0;jenkins-hbase20:39045] zookeeper.ZKUtil(162): regionserver:39045-0x1008273886f002c, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/rs/jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:41,936 DEBUG [RS:0;jenkins-hbase20:39045] regionserver.Replication(139): Replication stats-in-log period=5 seconds 2023-07-12 18:31:41,936 INFO [RS:0;jenkins-hbase20:39045] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:31:41,938 INFO [RS:0;jenkins-hbase20:39045] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:31:41,938 INFO [RS:0;jenkins-hbase20:39045] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:31:41,938 INFO [RS:0;jenkins-hbase20:39045] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:41,939 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:31:41,940 INFO [RS:0;jenkins-hbase20:39045] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:41,941 DEBUG [RS:0;jenkins-hbase20:39045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:41,941 DEBUG [RS:0;jenkins-hbase20:39045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:41,941 DEBUG [RS:0;jenkins-hbase20:39045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:41,941 DEBUG [RS:0;jenkins-hbase20:39045] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:41,941 DEBUG [RS:0;jenkins-hbase20:39045] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:41,941 DEBUG [RS:0;jenkins-hbase20:39045] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:41,941 DEBUG [RS:0;jenkins-hbase20:39045] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:41,941 DEBUG [RS:0;jenkins-hbase20:39045] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:41,941 DEBUG [RS:0;jenkins-hbase20:39045] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:41,941 DEBUG [RS:0;jenkins-hbase20:39045] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:41,943 INFO [RS:0;jenkins-hbase20:39045] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:41,943 INFO [RS:0;jenkins-hbase20:39045] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:41,943 INFO [RS:0;jenkins-hbase20:39045] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:41,952 INFO [RS:0;jenkins-hbase20:39045] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:31:41,952 INFO [RS:0;jenkins-hbase20:39045] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39045,1689186701549-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:41,961 INFO [RS:0;jenkins-hbase20:39045] regionserver.ReplicationSource(232): queueId=1, ReplicationSource: 1, currentBandwidth=0 2023-07-12 18:31:41,961 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=1; waited=100ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=0ms 2023-07-12 18:31:41,962 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager(266): Current list of replicators: [1689186691127.syncuptool.replication.org,1234,1] other RSs: [jenkins-hbase20.apache.org,39045,1689186701549] 2023-07-12 18:31:41,969 INFO [RS:0;jenkins-hbase20:39045] regionserver.Replication(203): jenkins-hbase20.apache.org,39045,1689186701549 started 2023-07-12 18:31:41,969 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,39045,1689186701549, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:39045, sessionid=0x1008273886f002c 2023-07-12 18:31:41,969 DEBUG [RS:0;jenkins-hbase20:39045] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:31:41,969 DEBUG [RS:0;jenkins-hbase20:39045] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:41,970 DEBUG [RS:0;jenkins-hbase20:39045] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,39045,1689186701549' 2023-07-12 18:31:41,970 DEBUG [RS:0;jenkins-hbase20:39045] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/1/flush-table-proc/abort' 2023-07-12 18:31:41,970 DEBUG [RS:0;jenkins-hbase20:39045] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/1/flush-table-proc/acquired' 2023-07-12 18:31:41,970 DEBUG [RS:0;jenkins-hbase20:39045] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:31:41,970 DEBUG [RS:0;jenkins-hbase20:39045] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:31:41,970 DEBUG [RS:0;jenkins-hbase20:39045] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:41,971 DEBUG [RS:0;jenkins-hbase20:39045] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,39045,1689186701549' 2023-07-12 18:31:41,971 DEBUG [RS:0;jenkins-hbase20:39045] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/1/online-snapshot/abort' 2023-07-12 18:31:41,971 DEBUG [RS:0;jenkins-hbase20:39045] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/1/online-snapshot/acquired' 2023-07-12 18:31:41,971 DEBUG [RS:0;jenkins-hbase20:39045] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:31:41,971 INFO [RS:0;jenkins-hbase20:39045] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:31:41,971 INFO [RS:0;jenkins-hbase20:39045] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:31:41,978 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x4d45ac34 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:41,982 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource,1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@344107c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:41,982 INFO [RS:0;jenkins-hbase20:39045.replicationSource,1] zookeeper.RecoverableZooKeeper(93): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:41,983 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 10x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:41,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): connection to cluster: 1-0x1008273886f0030 connected 2023-07-12 18:31:41,986 INFO [RS:0;jenkins-hbase20:39045.replicationSource,1] regionserver.ReplicationSource(586): peerId=1, queueId=1 (queues=0) is replicating from cluster=23c3b538-bf67-481b-8351-f0e7ae087693 to cluster=3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:42,029 DEBUG [jenkins-hbase20:36461] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-12 18:31:42,031 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,39045,1689186701549, state=OPENING 2023-07-12 18:31:42,032 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/1/meta-region-server 2023-07-12 18:31:42,032 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /1/meta-region-server: CHANGED 2023-07-12 18:31:42,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39045,1689186701549}] 2023-07-12 18:31:42,073 INFO [RS:0;jenkins-hbase20:39045] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39045%2C1689186701549, suffix=, logDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,39045,1689186701549, archiveDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs, maxLogs=10 2023-07-12 18:31:42,089 DEBUG [RS-EventLoopGroup-15-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK] 2023-07-12 18:31:42,089 DEBUG [RS-EventLoopGroup-15-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK] 2023-07-12 18:31:42,094 DEBUG [RS:0;jenkins-hbase20:39045] regionserver.ReplicationSourceManager(623): Start tracking logs for wal group jenkins-hbase20.apache.org%2C39045%2C1689186701549 for peer 1 2023-07-12 18:31:42,094 INFO [RS:0;jenkins-hbase20:39045] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,39045,1689186701549/jenkins-hbase20.apache.org%2C39045%2C1689186701549.1689186702074 2023-07-12 18:31:42,094 DEBUG [RS:0;jenkins-hbase20:39045] regionserver.ReplicationSource(346): peerId=1, starting shipping worker for walGroupId=jenkins-hbase20.apache.org%2C39045%2C1689186701549 2023-07-12 18:31:42,094 INFO [RS:0;jenkins-hbase20:39045] regionserver.ReplicationSourceWALReader(119): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2023-07-12 18:31:42,095 DEBUG [RS:0;jenkins-hbase20:39045] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK], DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK]] 2023-07-12 18:31:42,095 INFO [RS:0;jenkins-hbase20:39045.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSourceShipper(98): Running ReplicationSourceShipper Thread for wal group: jenkins-hbase20.apache.org%2C39045%2C1689186701549 2023-07-12 18:31:42,100 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:42,190 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:42,191 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:42,193 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:31:42,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 18:31:42,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:42,203 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39045%2C1689186701549.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,39045,1689186701549, archiveDir=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs, maxLogs=10 2023-07-12 18:31:42,205 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:42,219 DEBUG [RS-EventLoopGroup-15-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK] 2023-07-12 18:31:42,219 DEBUG [RS-EventLoopGroup-15-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK] 2023-07-12 18:31:42,220 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,39045,1689186701549/jenkins-hbase20.apache.org%2C39045%2C1689186701549.meta.1689186702203.meta 2023-07-12 18:31:42,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46573,DS-0ee8b2ea-cc1e-4306-bf57-e2de50feded4,DISK], DatanodeInfoWithStorage[127.0.0.1:34371,DS-72b414ff-1b76-438b-bc00-1f3bd7e4e424,DISK]] 2023-07-12 18:31:42,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:42,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 18:31:42,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 18:31:42,221 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 18:31:42,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 18:31:42,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:42,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 18:31:42,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 18:31:42,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 18:31:42,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/info 2023-07-12 18:31:42,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/info 2023-07-12 18:31:42,224 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 18:31:42,233 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/info/eb0e8ee42e3d4cd5b540060c3e157862 2023-07-12 18:31:42,233 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:42,233 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 18:31:42,234 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:42,234 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:42,235 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 18:31:42,241 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/rep_barrier/58c8b40dd20a4e3d83d45ca18e14c88a 2023-07-12 18:31:42,241 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:42,241 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 18:31:42,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/table 2023-07-12 18:31:42,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/table 2023-07-12 18:31:42,243 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 18:31:42,250 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/table/7c341cf751f3435f835307747ed1aa5f 2023-07-12 18:31:42,250 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:42,251 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740 2023-07-12 18:31:42,253 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740 2023-07-12 18:31:42,256 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 18:31:42,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 18:31:42,258 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=23; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69344188, jitterRate=0.03330892324447632}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 18:31:42,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 18:31:42,259 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=21, masterSystemTime=1689186702190 2023-07-12 18:31:42,265 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 18:31:42,267 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 18:31:42,267 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,39045,1689186701549, state=OPEN 2023-07-12 18:31:42,271 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/1/meta-region-server 2023-07-12 18:31:42,272 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /1/meta-region-server: CHANGED 2023-07-12 18:31:42,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-07-12 18:31:42,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39045,1689186701549 in 240 msec 2023-07-12 18:31:42,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-12 18:31:42,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 409 msec 2023-07-12 18:31:42,311 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:42,416 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:42,524 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:42,636 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:42,745 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:42,852 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:42,962 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:43,069 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:43,174 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:43,283 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:43,389 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:43,465 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=1; waited=1604ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=1504ms 2023-07-12 18:31:43,495 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:43,602 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:43,708 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:43,813 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:43,918 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:44,027 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:44,132 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:44,238 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:44,344 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:44,455 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:44,564 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:44,675 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:44,784 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:44,895 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:44,969 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=1; waited=3108ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=3008ms 2023-07-12 18:31:45,000 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:45,065 INFO [jenkins-hbase20:38715Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:45,065 INFO [jenkins-hbase20:38715Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Sink: age in ms of last applied edit: 0, total replicated edits: 2 2023-07-12 18:31:45,104 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:45,211 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:45,323 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:45,432 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:45,543 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:45,653 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:45,758 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:45,863 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:45,968 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:46,078 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:46,185 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:46,294 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:46,358 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 18:31:46,372 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=4511ms, expected min=1 server(s), max=NO_LIMIT server(s), master is running 2023-07-12 18:31:46,372 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 18:31:46,376 DEBUG [hconnection-0x1b09b475-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:46,377 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:46,384 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=340cf179e3faa54372c069aa2490aad9, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,37271,1689186672154, regionLocation=jenkins-hbase20.apache.org,37271,1689186672154, openSeqNum=2 2023-07-12 18:31:46,384 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=80b2b4fe906f78b38a7d69ad08dadb13, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,37271,1689186672154, regionLocation=jenkins-hbase20.apache.org,37271,1689186672154, openSeqNum=2 2023-07-12 18:31:46,385 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=93e6956722d05ec4972c3a5270b9ac18, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,40805,1689186672112, regionLocation=jenkins-hbase20.apache.org,40805,1689186672112, openSeqNum=2 2023-07-12 18:31:46,385 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-12 18:31:46,385 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689186766385 2023-07-12 18:31:46,385 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689186826385 2023-07-12 18:31:46,385 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 12 msec 2023-07-12 18:31:46,400 INFO [PEWorker-4] procedure.ServerCrashProcedure(199): jenkins-hbase20.apache.org,37271,1689186672154 had 3 regions 2023-07-12 18:31:46,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36461,1689186701487-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:46,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36461,1689186701487-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:46,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36461,1689186701487-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:46,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:36461, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:46,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:46,400 WARN [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1240): hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. is NOT online; state={340cf179e3faa54372c069aa2490aad9 state=OPEN, ts=1689186706384, server=jenkins-hbase20.apache.org,37271,1689186672154}; ServerCrashProcedures=true. Master startup cannot progress, in holding-pattern until region onlined. 2023-07-12 18:31:46,401 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:46,404 INFO [PEWorker-4] procedure.ServerCrashProcedure(300): Splitting WALs pid=19, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,37271,1689186672154, splitWal=true, meta=true, isMeta: false 2023-07-12 18:31:46,404 INFO [PEWorker-5] procedure.ServerCrashProcedure(199): jenkins-hbase20.apache.org,40805,1689186672112 had 1 regions 2023-07-12 18:31:46,406 INFO [PEWorker-4] master.SplitLogManager(171): hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154-splitting dir is empty, no logs to split. 2023-07-12 18:31:46,406 INFO [PEWorker-4] master.SplitWALManager(106): jenkins-hbase20.apache.org,37271,1689186672154 WAL count=0, meta=false 2023-07-12 18:31:46,406 INFO [PEWorker-5] procedure.ServerCrashProcedure(300): Splitting WALs pid=18, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,40805,1689186672112, splitWal=true, meta=false, isMeta: false 2023-07-12 18:31:46,408 DEBUG [PEWorker-5] master.MasterWalManager(318): Renamed region directory: hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112-splitting 2023-07-12 18:31:46,409 INFO [PEWorker-5] master.SplitLogManager(171): hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112-splitting dir is empty, no logs to split. 2023-07-12 18:31:46,409 INFO [PEWorker-5] master.SplitWALManager(106): jenkins-hbase20.apache.org,40805,1689186672112 WAL count=0, meta=false 2023-07-12 18:31:46,411 INFO [PEWorker-4] master.SplitLogManager(171): hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,37271,1689186672154-splitting dir is empty, no logs to split. 2023-07-12 18:31:46,411 INFO [PEWorker-4] master.SplitWALManager(106): jenkins-hbase20.apache.org,37271,1689186672154 WAL count=0, meta=false 2023-07-12 18:31:46,411 DEBUG [PEWorker-4] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,37271,1689186672154 WAL splitting is done? wals=0, meta=false 2023-07-12 18:31:46,412 WARN [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(172): unknown_server=jenkins-hbase20.apache.org,37271,1689186672154/hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9., unknown_server=jenkins-hbase20.apache.org,37271,1689186672154/t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13., unknown_server=jenkins-hbase20.apache.org,40805,1689186672112/t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:46,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=340cf179e3faa54372c069aa2490aad9, ASSIGN}, {pid=23, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1_syncup, region=80b2b4fe906f78b38a7d69ad08dadb13, ASSIGN}] 2023-07-12 18:31:46,414 INFO [PEWorker-5] master.SplitLogManager(171): hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112-splitting dir is empty, no logs to split. 2023-07-12 18:31:46,414 INFO [PEWorker-5] master.SplitWALManager(106): jenkins-hbase20.apache.org,40805,1689186672112 WAL count=0, meta=false 2023-07-12 18:31:46,414 DEBUG [PEWorker-5] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,40805,1689186672112 WAL splitting is done? wals=0, meta=false 2023-07-12 18:31:46,414 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=340cf179e3faa54372c069aa2490aad9, ASSIGN 2023-07-12 18:31:46,415 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1_syncup, region=80b2b4fe906f78b38a7d69ad08dadb13, ASSIGN 2023-07-12 18:31:46,415 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=t1_syncup, region=80b2b4fe906f78b38a7d69ad08dadb13, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:46,416 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=22, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=340cf179e3faa54372c069aa2490aad9, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:46,416 DEBUG [jenkins-hbase20:36461] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-12 18:31:46,419 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=80b2b4fe906f78b38a7d69ad08dadb13, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:46,419 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186706418"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186706418"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186706418"}]},"ts":"1689186706418"} 2023-07-12 18:31:46,419 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=340cf179e3faa54372c069aa2490aad9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:46,420 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186706419"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186706419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186706419"}]},"ts":"1689186706419"} 2023-07-12 18:31:46,420 INFO [PEWorker-5] procedure.ServerCrashProcedure(282): Remove WAL directory for jenkins-hbase20.apache.org,40805,1689186672112 failed, ignore...File hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,40805,1689186672112-splitting does not exist. 2023-07-12 18:31:46,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t2_syncup, region=93e6956722d05ec4972c3a5270b9ac18, ASSIGN}] 2023-07-12 18:31:46,421 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t2_syncup, region=93e6956722d05ec4972c3a5270b9ac18, ASSIGN 2023-07-12 18:31:46,422 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=t2_syncup, region=93e6956722d05ec4972c3a5270b9ac18, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:46,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure 80b2b4fe906f78b38a7d69ad08dadb13, server=jenkins-hbase20.apache.org,39045,1689186701549}] 2023-07-12 18:31:46,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=22, state=RUNNABLE; OpenRegionProcedure 340cf179e3faa54372c069aa2490aad9, server=jenkins-hbase20.apache.org,39045,1689186701549}] 2023-07-12 18:31:46,505 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 83 2023-07-12 18:31:46,573 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=93e6956722d05ec4972c3a5270b9ac18, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:46,574 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186706573"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186706573"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186706573"}]},"ts":"1689186706573"} 2023-07-12 18:31:46,575 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=24, state=RUNNABLE; OpenRegionProcedure 93e6956722d05ec4972c3a5270b9ac18, server=jenkins-hbase20.apache.org,39045,1689186701549}] 2023-07-12 18:31:46,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:46,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93e6956722d05ec4972c3a5270b9ac18, NAME => 't2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:46,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table t2_syncup 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:46,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:46,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:46,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:46,583 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:46,584 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:46,584 DEBUG [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/cf1 2023-07-12 18:31:46,584 DEBUG [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/cf1 2023-07-12 18:31:46,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 340cf179e3faa54372c069aa2490aad9, NAME => 'hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:46,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:46,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:46,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:46,584 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93e6956722d05ec4972c3a5270b9ac18 columnFamilyName cf1 2023-07-12 18:31:46,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:46,586 INFO [StoreOpener-340cf179e3faa54372c069aa2490aad9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:46,587 DEBUG [StoreOpener-340cf179e3faa54372c069aa2490aad9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/info 2023-07-12 18:31:46,587 DEBUG [StoreOpener-340cf179e3faa54372c069aa2490aad9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/info 2023-07-12 18:31:46,587 INFO [StoreOpener-340cf179e3faa54372c069aa2490aad9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 340cf179e3faa54372c069aa2490aad9 columnFamilyName info 2023-07-12 18:31:46,592 INFO [StoreFileOpener-cf1-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c890b7390e4b45ed9d46cb3a91fd3d0a 2023-07-12 18:31:46,593 DEBUG [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/cf1/c890b7390e4b45ed9d46cb3a91fd3d0a 2023-07-12 18:31:46,593 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] regionserver.HStore(310): Store=93e6956722d05ec4972c3a5270b9ac18/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:46,593 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family norep of region 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:46,594 DEBUG [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/norep 2023-07-12 18:31:46,594 DEBUG [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/norep 2023-07-12 18:31:46,595 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93e6956722d05ec4972c3a5270b9ac18 columnFamilyName norep 2023-07-12 18:31:46,595 DEBUG [StoreOpener-340cf179e3faa54372c069aa2490aad9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/info/05fc832224a34e178069d0d1118bd8c8 2023-07-12 18:31:46,595 INFO [StoreOpener-340cf179e3faa54372c069aa2490aad9-1] regionserver.HStore(310): Store=340cf179e3faa54372c069aa2490aad9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:46,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:46,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:46,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:46,601 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 340cf179e3faa54372c069aa2490aad9; next sequenceid=10; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67301452, jitterRate=0.0028697848320007324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:31:46,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 340cf179e3faa54372c069aa2490aad9: 2023-07-12 18:31:46,602 INFO [StoreFileOpener-norep-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51d3eaf958514334a8fcf4136ced815e 2023-07-12 18:31:46,602 DEBUG [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/norep/51d3eaf958514334a8fcf4136ced815e 2023-07-12 18:31:46,602 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9., pid=26, masterSystemTime=1689186706578 2023-07-12 18:31:46,602 INFO [StoreOpener-93e6956722d05ec4972c3a5270b9ac18-1] regionserver.HStore(310): Store=93e6956722d05ec4972c3a5270b9ac18/norep, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:46,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:46,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:46,605 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:46,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:46,606 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=340cf179e3faa54372c069aa2490aad9, regionState=OPEN, openSeqNum=10, regionLocation=jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:46,606 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186706606"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186706606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186706606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186706606"}]},"ts":"1689186706606"} 2023-07-12 18:31:46,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table t2_syncup descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 18:31:46,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=22 2023-07-12 18:31:46,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=22, state=SUCCESS; OpenRegionProcedure 340cf179e3faa54372c069aa2490aad9, server=jenkins-hbase20.apache.org,39045,1689186701549 in 182 msec 2023-07-12 18:31:46,610 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 423 2023-07-12 18:31:46,610 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSourceWALReader(162): Read 0 WAL entries eligible for replication 2023-07-12 18:31:46,610 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 423 2023-07-12 18:31:46,610 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,39045,1689186701549/jenkins-hbase20.apache.org%2C39045%2C1689186701549.1689186702074, lastWalPosition=423, nbRowKeys=0, nbHFiles=0, heapSize=0, lastSeqIds={}, endOfFile=false,usedBufferSize=0] 2023-07-12 18:31:46,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:46,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=340cf179e3faa54372c069aa2490aad9, ASSIGN in 197 msec 2023-07-12 18:31:46,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 93e6956722d05ec4972c3a5270b9ac18; next sequenceid=210; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66998912, jitterRate=-0.0016384124755859375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 18:31:46,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 93e6956722d05ec4972c3a5270b9ac18: 2023-07-12 18:31:46,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18., pid=27, masterSystemTime=1689186706578 2023-07-12 18:31:46,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:46,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:46,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:46,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80b2b4fe906f78b38a7d69ad08dadb13, NAME => 't1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:46,615 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=93e6956722d05ec4972c3a5270b9ac18, regionState=OPEN, repBarrier=210, openSeqNum=210, regionLocation=jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:46,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table t1_syncup 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:46,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:46,615 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":6,"row":"t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18.","families":{"rep_barrier":[],"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186706615"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186706615"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186706615"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186706615"}]},"ts":"1689186706615"} 2023-07-12 18:31:46,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:46,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:46,617 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:46,618 DEBUG [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/cf1 2023-07-12 18:31:46,618 DEBUG [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/cf1 2023-07-12 18:31:46,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=24 2023-07-12 18:31:46,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=24, state=SUCCESS; OpenRegionProcedure 93e6956722d05ec4972c3a5270b9ac18, server=jenkins-hbase20.apache.org,39045,1689186701549 in 42 msec 2023-07-12 18:31:46,618 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80b2b4fe906f78b38a7d69ad08dadb13 columnFamilyName cf1 2023-07-12 18:31:46,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-07-12 18:31:46,620 INFO [PEWorker-4] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase20.apache.org,40805,1689186672112 after splitting done 2023-07-12 18:31:46,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=t2_syncup, region=93e6956722d05ec4972c3a5270b9ac18, ASSIGN in 197 msec 2023-07-12 18:31:46,620 DEBUG [PEWorker-4] master.DeadServer(114): Removed jenkins-hbase20.apache.org,40805,1689186672112 from processing; numProcessing=1 2023-07-12 18:31:46,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,40805,1689186672112, splitWal=true, meta=false in 4.8430 sec 2023-07-12 18:31:46,627 INFO [StoreFileOpener-cf1-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9ded99dd0ea47bdbd03569955226f38 2023-07-12 18:31:46,627 DEBUG [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/cf1/b9ded99dd0ea47bdbd03569955226f38 2023-07-12 18:31:46,628 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] regionserver.HStore(310): Store=80b2b4fe906f78b38a7d69ad08dadb13/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:46,628 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family norep of region 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:46,629 DEBUG [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/norep 2023-07-12 18:31:46,629 DEBUG [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/norep 2023-07-12 18:31:46,629 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80b2b4fe906f78b38a7d69ad08dadb13 columnFamilyName norep 2023-07-12 18:31:46,635 INFO [StoreFileOpener-norep-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86f9ef8f80a949e7b296fe2ac8abc6e2 2023-07-12 18:31:46,636 DEBUG [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/norep/86f9ef8f80a949e7b296fe2ac8abc6e2 2023-07-12 18:31:46,636 INFO [StoreOpener-80b2b4fe906f78b38a7d69ad08dadb13-1] regionserver.HStore(310): Store=80b2b4fe906f78b38a7d69ad08dadb13/norep, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:46,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:46,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:46,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table t1_syncup descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 18:31:46,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:46,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 80b2b4fe906f78b38a7d69ad08dadb13; next sequenceid=110; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68546076, jitterRate=0.021416127681732178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 18:31:46,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 80b2b4fe906f78b38a7d69ad08dadb13: 2023-07-12 18:31:46,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13., pid=25, masterSystemTime=1689186706578 2023-07-12 18:31:46,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:46,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:46,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=80b2b4fe906f78b38a7d69ad08dadb13, regionState=OPEN, repBarrier=110, openSeqNum=110, regionLocation=jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:46,645 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":6,"row":"t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13.","families":{"rep_barrier":[],"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186706645"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186706645"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186706645"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186706645"}]},"ts":"1689186706645"} 2023-07-12 18:31:46,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-12 18:31:46,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure 80b2b4fe906f78b38a7d69ad08dadb13, server=jenkins-hbase20.apache.org,39045,1689186701549 in 222 msec 2023-07-12 18:31:46,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=19 2023-07-12 18:31:46,650 INFO [PEWorker-3] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase20.apache.org,37271,1689186672154 after splitting done 2023-07-12 18:31:46,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=t1_syncup, region=80b2b4fe906f78b38a7d69ad08dadb13, ASSIGN in 235 msec 2023-07-12 18:31:46,650 DEBUG [PEWorker-3] master.DeadServer(114): Removed jenkins-hbase20.apache.org,37271,1689186672154 from processing; numProcessing=0 2023-07-12 18:31:46,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,37271,1689186672154, splitWal=true, meta=true in 4.8700 sec 2023-07-12 18:31:46,715 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:46,715 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSourceWALReader(162): Read 0 WAL entries eligible for replication 2023-07-12 18:31:46,715 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:46,715 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,39045,1689186701549/jenkins-hbase20.apache.org%2C39045%2C1689186701549.1689186702074, lastWalPosition=1165, nbRowKeys=0, nbHFiles=0, heapSize=0, lastSeqIds={}, endOfFile=false,usedBufferSize=0] 2023-07-12 18:31:46,820 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:46,929 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:46,969 INFO [jenkins-hbase20:39045Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [jenkins-hbase20.apache.org%2C39045%2C1689186701549]: currently replicating from: hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,39045,1689186701549/jenkins-hbase20.apache.org%2C39045%2C1689186701549.1689186702074 at position: 1165 2023-07-12 18:31:47,039 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:47,145 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:47,255 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:47,366 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:47,402 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on existing znode=/1/namespace 2023-07-12 18:31:47,421 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/1/namespace/default 2023-07-12 18:31:47,424 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/1/namespace/hbase 2023-07-12 18:31:47,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 5.839sec 2023-07-12 18:31:47,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 18:31:47,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 18:31:47,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 18:31:47,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36461,1689186701487-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 18:31:47,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36461,1689186701487-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 18:31:47,427 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 18:31:47,474 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:47,486 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(139): Connect 0x15ef1300 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:47,492 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dd9064b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:47,495 DEBUG [hconnection-0x62202a61-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:47,497 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:47,507 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(1262): HBase has been restarted 2023-07-12 18:31:47,507 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15ef1300 to 127.0.0.1:64028 2023-07-12 18:31:47,507 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:47,509 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(2939): Invalidated connection. Updating master addresses before: jenkins-hbase20.apache.org:36461 after: jenkins-hbase20.apache.org:36461 2023-07-12 18:31:47,509 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(139): Connect 0x1121c92c to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:47,512 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72319a4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:47,513 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x155f3e64 to 127.0.0.1:64028 2023-07-12 18:31:47,513 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:47,513 DEBUG [Listener at localhost.localdomain/40201] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 18:31:47,513 DEBUG [Listener at localhost.localdomain/40201] util.JVMClusterUtil(257): Found active master hash=736695787, stopped=false 2023-07-12 18:31:47,513 INFO [Listener at localhost.localdomain/40201] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:47,514 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/running 2023-07-12 18:31:47,514 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/running 2023-07-12 18:31:47,514 INFO [Listener at localhost.localdomain/40201] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 18:31:47,514 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:47,516 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d3e0322 to 127.0.0.1:64028 2023-07-12 18:31:47,516 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:47,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:47,517 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38715,1689186684627' ***** 2023-07-12 18:31:47,517 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:31:47,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:47,517 INFO [RS:0;jenkins-hbase20:38715] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:31:47,517 INFO [RS:0;jenkins-hbase20:38715] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:31:47,517 INFO [RS:0;jenkins-hbase20:38715] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:31:47,517 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(3305): Received CLOSE for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:47,518 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:31:47,518 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(3305): Received CLOSE for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:47,519 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(3305): Received CLOSE for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:47,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 63272e89b8aafccb1ffb2f93ed48b12c, disabling compactions & flushes 2023-07-12 18:31:47,520 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:47,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:47,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:47,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. after waiting 0 ms 2023-07-12 18:31:47,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:47,520 DEBUG [RS:0;jenkins-hbase20:38715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39d0ecef to 127.0.0.1:64028 2023-07-12 18:31:47,520 DEBUG [RS:0;jenkins-hbase20:38715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:47,520 INFO [RS:0;jenkins-hbase20:38715] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:31:47,520 INFO [RS:0;jenkins-hbase20:38715] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:31:47,520 INFO [RS:0;jenkins-hbase20:38715] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:31:47,520 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 18:31:47,521 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-07-12 18:31:47,522 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1478): Online Regions={63272e89b8aafccb1ffb2f93ed48b12c=hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c., bde3b0e33054f5210b7a78be27604e3f=t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f., 1588230740=hbase:meta,,1.1588230740, e22f590dd8a98a0fba12251b93336902=t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.} 2023-07-12 18:31:47,523 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 18:31:47,523 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1504): Waiting on 1588230740, 63272e89b8aafccb1ffb2f93ed48b12c, bde3b0e33054f5210b7a78be27604e3f, e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:47,523 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 18:31:47,524 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 18:31:47,524 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 18:31:47,524 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 18:31:47,524 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.73 KB heapSize=5.24 KB 2023-07-12 18:31:47,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=9 2023-07-12 18:31:47,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:47,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 63272e89b8aafccb1ffb2f93ed48b12c: 2023-07-12 18:31:47,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:47,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bde3b0e33054f5210b7a78be27604e3f, disabling compactions & flushes 2023-07-12 18:31:47,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:47,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:47,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. after waiting 0 ms 2023-07-12 18:31:47,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:47,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing bde3b0e33054f5210b7a78be27604e3f 2/2 column families, dataSize=2.72 KB heapSize=10.66 KB 2023-07-12 18:31:47,546 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.73 KB at sequenceid=31 (bloomFilter=false), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/.tmp/info/7f70654f679f470fae2ba97cc73e6aef 2023-07-12 18:31:47,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.72 KB at sequenceid=15 (bloomFilter=true), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/.tmp/cf1/7545e7a02e30411892f652343fef209d 2023-07-12 18:31:47,555 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/.tmp/info/7f70654f679f470fae2ba97cc73e6aef as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info/7f70654f679f470fae2ba97cc73e6aef 2023-07-12 18:31:47,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7545e7a02e30411892f652343fef209d 2023-07-12 18:31:47,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/.tmp/cf1/7545e7a02e30411892f652343fef209d as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1/7545e7a02e30411892f652343fef209d 2023-07-12 18:31:47,563 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:47,566 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info/7f70654f679f470fae2ba97cc73e6aef, entries=24, sequenceid=31, filesize=7.4 K 2023-07-12 18:31:47,567 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.73 KB/2792, heapSize ~4.73 KB/4840, currentSize=0 B/0 for 1588230740 in 43ms, sequenceid=31, compaction requested=false 2023-07-12 18:31:47,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7545e7a02e30411892f652343fef209d 2023-07-12 18:31:47,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1/7545e7a02e30411892f652343fef209d, entries=100, sequenceid=15, filesize=7.9 K 2023-07-12 18:31:47,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.72 KB/2790, heapSize ~10.39 KB/10640, currentSize=0 B/0 for bde3b0e33054f5210b7a78be27604e3f in 39ms, sequenceid=15, compaction requested=false 2023-07-12 18:31:47,595 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:47,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/recovered.edits/18.seqid, newMaxSeqId=18, maxSeqId=11 2023-07-12 18:31:47,601 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/recovered.edits/34.seqid, newMaxSeqId=34, maxSeqId=22 2023-07-12 18:31:47,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:47,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bde3b0e33054f5210b7a78be27604e3f: 2023-07-12 18:31:47,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:47,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e22f590dd8a98a0fba12251b93336902, disabling compactions & flushes 2023-07-12 18:31:47,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:47,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:47,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. after waiting 0 ms 2023-07-12 18:31:47,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:47,604 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 18:31:47,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e22f590dd8a98a0fba12251b93336902 2/2 column families, dataSize=1.36 KB heapSize=5.58 KB 2023-07-12 18:31:47,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 18:31:47,605 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 18:31:47,605 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 18:31:47,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.36 KB at sequenceid=14 (bloomFilter=true), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/.tmp/cf1/e605252f78384e43802c06099f8d418c 2023-07-12 18:31:47,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e605252f78384e43802c06099f8d418c 2023-07-12 18:31:47,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/.tmp/cf1/e605252f78384e43802c06099f8d418c as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1/e605252f78384e43802c06099f8d418c 2023-07-12 18:31:47,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e605252f78384e43802c06099f8d418c 2023-07-12 18:31:47,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1/e605252f78384e43802c06099f8d418c, entries=50, sequenceid=14, filesize=6.4 K 2023-07-12 18:31:47,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.36 KB/1390, heapSize ~5.31 KB/5440, currentSize=0 B/0 for e22f590dd8a98a0fba12251b93336902 in 30ms, sequenceid=14, compaction requested=false 2023-07-12 18:31:47,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=10 2023-07-12 18:31:47,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:47,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e22f590dd8a98a0fba12251b93336902: 2023-07-12 18:31:47,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:47,700 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:47,723 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38715,1689186684627; all regions closed. 2023-07-12 18:31:47,734 DEBUG [RS:0;jenkins-hbase20:38715] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs 2023-07-12 18:31:47,734 INFO [RS:0;jenkins-hbase20:38715] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38715%2C1689186684627.meta:.meta(num 1689186685260) 2023-07-12 18:31:47,741 DEBUG [RS:0;jenkins-hbase20:38715] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs 2023-07-12 18:31:47,741 INFO [RS:0;jenkins-hbase20:38715] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38715%2C1689186684627:(num 1689186685171) 2023-07-12 18:31:47,741 DEBUG [RS:0;jenkins-hbase20:38715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:47,741 INFO [RS:0;jenkins-hbase20:38715] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:47,741 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 18:31:47,741 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:47,742 DEBUG [RS:0;jenkins-hbase20:38715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x618bd7ea to 127.0.0.1:64028 2023-07-12 18:31:47,742 DEBUG [RS:0;jenkins-hbase20:38715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:47,743 INFO [RS:0;jenkins-hbase20:38715] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38715 2023-07-12 18:31:47,747 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f002a, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:47,747 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,38715,1689186684627 2023-07-12 18:31:47,748 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:31:47,748 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0027, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:47,747 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:47,748 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:31:47,748 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:47,748 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38715,1689186684627] 2023-07-12 18:31:47,748 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38715,1689186684627; numProcessing=1 2023-07-12 18:31:47,749 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /2/draining/jenkins-hbase20.apache.org,38715,1689186684627 already deleted, retry=false 2023-07-12 18:31:47,749 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38715,1689186684627 expired; onlineServers=0 2023-07-12 18:31:47,749 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,41187,1689186684595' ***** 2023-07-12 18:31:47,749 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 18:31:47,750 DEBUG [M:0;jenkins-hbase20:41187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fd6944e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:47,750 INFO [M:0;jenkins-hbase20:41187] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,41187,1689186684595 2023-07-12 18:31:47,750 INFO [M:0;jenkins-hbase20:41187] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,41187,1689186684595; all regions closed. 2023-07-12 18:31:47,750 DEBUG [M:0;jenkins-hbase20:41187] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:47,750 DEBUG [M:0;jenkins-hbase20:41187] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 18:31:47,750 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 18:31:47,750 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186684923] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186684923,5,FailOnTimeoutGroup] 2023-07-12 18:31:47,750 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186684923] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186684923,5,FailOnTimeoutGroup] 2023-07-12 18:31:47,750 DEBUG [M:0;jenkins-hbase20:41187] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 18:31:47,753 INFO [M:0;jenkins-hbase20:41187] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 18:31:47,753 INFO [M:0;jenkins-hbase20:41187] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 18:31:47,753 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/master 2023-07-12 18:31:47,753 INFO [M:0;jenkins-hbase20:41187] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-07-12 18:31:47,753 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:47,753 DEBUG [M:0;jenkins-hbase20:41187] master.HMaster(1512): Stopping service threads 2023-07-12 18:31:47,753 INFO [M:0;jenkins-hbase20:41187] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 18:31:47,754 ERROR [M:0;jenkins-hbase20:41187] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 18:31:47,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:31:47,755 INFO [M:0;jenkins-hbase20:41187] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 18:31:47,755 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 18:31:47,755 DEBUG [M:0;jenkins-hbase20:41187] zookeeper.ZKUtil(398): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Unable to get data of znode /2/master because node does not exist (not an error) 2023-07-12 18:31:47,755 WARN [M:0;jenkins-hbase20:41187] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 18:31:47,755 INFO [M:0;jenkins-hbase20:41187] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 18:31:47,756 INFO [M:0;jenkins-hbase20:41187] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 18:31:47,757 DEBUG [M:0;jenkins-hbase20:41187] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 18:31:47,757 INFO [M:0;jenkins-hbase20:41187] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:47,757 DEBUG [M:0;jenkins-hbase20:41187] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:47,757 DEBUG [M:0;jenkins-hbase20:41187] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 18:31:47,757 DEBUG [M:0;jenkins-hbase20:41187] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:47,757 INFO [M:0;jenkins-hbase20:41187] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=36.04 KB heapSize=44.82 KB 2023-07-12 18:31:47,769 INFO [M:0;jenkins-hbase20:41187] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=36.04 KB at sequenceid=219 (bloomFilter=true), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5757662de28b4a8085ebee26abdc1c0c 2023-07-12 18:31:47,774 DEBUG [M:0;jenkins-hbase20:41187] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5757662de28b4a8085ebee26abdc1c0c as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5757662de28b4a8085ebee26abdc1c0c 2023-07-12 18:31:47,779 INFO [M:0;jenkins-hbase20:41187] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5757662de28b4a8085ebee26abdc1c0c, entries=12, sequenceid=219, filesize=6.4 K 2023-07-12 18:31:47,779 INFO [M:0;jenkins-hbase20:41187] regionserver.HRegion(2948): Finished flush of dataSize ~36.04 KB/36905, heapSize ~44.80 KB/45880, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=219, compaction requested=false 2023-07-12 18:31:47,782 INFO [M:0;jenkins-hbase20:41187] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:47,782 DEBUG [M:0;jenkins-hbase20:41187] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:31:47,786 INFO [M:0;jenkins-hbase20:41187] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 18:31:47,786 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:47,787 INFO [M:0;jenkins-hbase20:41187] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41187 2023-07-12 18:31:47,790 DEBUG [M:0;jenkins-hbase20:41187] zookeeper.RecoverableZooKeeper(172): Node /2/rs/jenkins-hbase20.apache.org,41187,1689186684595 already deleted, retry=false 2023-07-12 18:31:47,805 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:47,919 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:48,015 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:48,015 INFO [M:0;jenkins-hbase20:41187] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,41187,1689186684595; zookeeper connection closed. 2023-07-12 18:31:48,015 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:41187-0x1008273886f001d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:48,024 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:48,116 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:48,116 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x1008273886f001e, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:48,116 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38715,1689186684627; zookeeper connection closed. 2023-07-12 18:31:48,118 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@790c9130] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@790c9130 2023-07-12 18:31:48,119 INFO [Listener at localhost.localdomain/40201] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-12 18:31:48,123 DEBUG [hconnection-0x13991059-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:48,127 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:48,134 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 1165 2023-07-12 18:31:48,246 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 13411 2023-07-12 18:31:48,246 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSourceWALReader(162): Read 115 WAL entries eligible for replication 2023-07-12 18:31:48,246 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 13411 2023-07-12 18:31:48,247 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSourceShipper(110): Shipper from source 1 got entry batch from reader: WALEntryBatch [walEntries=[{t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/112=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/113=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/114=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/115=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/116=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/117=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/118=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/119=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/120=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/121=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/122=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/123=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/124=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/125=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/126=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/127=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/128=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/129=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/130=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/131=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/132=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/133=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/134=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/135=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/136=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/137=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/138=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/139=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/140=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/141=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/142=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/143=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/144=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/145=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/146=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/147=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/148=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/149=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/150=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/151=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/152=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/153=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/154=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/155=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/156=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/157=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/158=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/159=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/160=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/161=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/162=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/163=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/164=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/165=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/166=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/167=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/168=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/169=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/170=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/171=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/172=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/173=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/174=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/175=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/176=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/177=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/178=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/179=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/180=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/181=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/182=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/183=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/184=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/185=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/186=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/187=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/188=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/189=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/190=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/191=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/192=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/193=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/194=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/195=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/196=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/197=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/198=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/199=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/200=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/201=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/202=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/203=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/204=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/205=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/206=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/207=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/208=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/209=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/210=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/211=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/212=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/213=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/214=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/215=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/216=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/217=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/218=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/219=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/220=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/221=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/222=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/223=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/224=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/225=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/226=[#edits: 1 = ],208}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/WALs/jenkins-hbase20.apache.org,39045,1689186701549/jenkins-hbase20.apache.org%2C39045%2C1689186701549.1689186702074, lastWalPosition=13411, nbRowKeys=115, nbHFiles=0, heapSize=23920, lastSeqIds={}, endOfFile=false,usedBufferSize=23920] 2023-07-12 18:31:48,250 WARN [RS:0;jenkins-hbase20:39045.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSinkManager(154): No sinks available at peer. Will not be able to replicate 2023-07-12 18:31:48,351 WARN [RS:0;jenkins-hbase20:39045.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSinkManager(154): No sinks available at peer. Will not be able to replicate 2023-07-12 18:31:48,358 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 29333 2023-07-12 18:31:48,358 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSourceWALReader(162): Read 149 WAL entries eligible for replication 2023-07-12 18:31:48,358 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 29333 2023-07-12 18:31:48,396 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1121c92c to 127.0.0.1:64028 2023-07-12 18:31:48,396 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:48,396 DEBUG [Listener at localhost.localdomain/40201] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 18:31:48,396 DEBUG [Listener at localhost.localdomain/40201] util.JVMClusterUtil(257): Found active master hash=337329933, stopped=false 2023-07-12 18:31:48,396 INFO [Listener at localhost.localdomain/40201] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,36461,1689186701487 2023-07-12 18:31:48,397 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1008273886f002c, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/running 2023-07-12 18:31:48,397 INFO [Listener at localhost.localdomain/40201] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 18:31:48,397 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/running 2023-07-12 18:31:48,397 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:48,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1008273886f002c, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/running 2023-07-12 18:31:48,400 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6144d79e to 127.0.0.1:64028 2023-07-12 18:31:48,400 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:48,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/running 2023-07-12 18:31:48,400 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,39045,1689186701549' ***** 2023-07-12 18:31:48,400 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:31:48,400 INFO [RS:0;jenkins-hbase20:39045] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:31:48,400 INFO [RS:0;jenkins-hbase20:39045] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:31:48,400 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:31:48,401 INFO [RS:0;jenkins-hbase20:39045] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:31:48,401 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(3305): Received CLOSE for 80b2b4fe906f78b38a7d69ad08dadb13 2023-07-12 18:31:48,402 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(3305): Received CLOSE for 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:48,402 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(3305): Received CLOSE for 340cf179e3faa54372c069aa2490aad9 2023-07-12 18:31:48,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 80b2b4fe906f78b38a7d69ad08dadb13, disabling compactions & flushes 2023-07-12 18:31:48,403 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:48,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:48,403 DEBUG [RS:0;jenkins-hbase20:39045] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x197ca5b7 to 127.0.0.1:64028 2023-07-12 18:31:48,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:48,403 DEBUG [RS:0;jenkins-hbase20:39045] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:48,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. after waiting 0 ms 2023-07-12 18:31:48,403 INFO [RS:0;jenkins-hbase20:39045] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:31:48,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:48,403 INFO [RS:0;jenkins-hbase20:39045] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:31:48,403 INFO [RS:0;jenkins-hbase20:39045] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:31:48,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 80b2b4fe906f78b38a7d69ad08dadb13 2/2 column families, dataSize=3.44 KB heapSize=11.55 KB 2023-07-12 18:31:48,403 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 18:31:48,404 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-07-12 18:31:48,404 DEBUG [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1478): Online Regions={80b2b4fe906f78b38a7d69ad08dadb13=t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13., 1588230740=hbase:meta,,1.1588230740, 93e6956722d05ec4972c3a5270b9ac18=t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18., 340cf179e3faa54372c069aa2490aad9=hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9.} 2023-07-12 18:31:48,404 DEBUG [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1504): Waiting on 1588230740, 340cf179e3faa54372c069aa2490aad9, 80b2b4fe906f78b38a7d69ad08dadb13, 93e6956722d05ec4972c3a5270b9ac18 2023-07-12 18:31:48,405 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 18:31:48,405 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 18:31:48,405 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 18:31:48,405 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 18:31:48,405 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 18:31:48,405 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.95 KB heapSize=5.62 KB 2023-07-12 18:31:48,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.40 KB at sequenceid=213 (bloomFilter=true), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/.tmp/cf1/3c4ff5c8be054161805dab9c5604fe55 2023-07-12 18:31:48,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.73 KB at sequenceid=31 (bloomFilter=false), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/.tmp/info/760c0b635c10455ead46916f915ce2b3 2023-07-12 18:31:48,445 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=226 B at sequenceid=31 (bloomFilter=false), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/.tmp/rep_barrier/ffa2a8f71295483cba64c82ba5d6eb85 2023-07-12 18:31:48,449 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:48,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=41 B at sequenceid=213 (bloomFilter=true), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/.tmp/norep/430cdb5982624661b4ad4015ba6e8154 2023-07-12 18:31:48,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/.tmp/info/760c0b635c10455ead46916f915ce2b3 as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/info/760c0b635c10455ead46916f915ce2b3 2023-07-12 18:31:48,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/.tmp/cf1/3c4ff5c8be054161805dab9c5604fe55 as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/cf1/3c4ff5c8be054161805dab9c5604fe55 2023-07-12 18:31:48,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/info/760c0b635c10455ead46916f915ce2b3, entries=24, sequenceid=31, filesize=7.4 K 2023-07-12 18:31:48,464 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] wal.ProtobufLogReader(420): EOF at position 33576 2023-07-12 18:31:48,464 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSourceWALReader(162): Read 36 WAL entries eligible for replication 2023-07-12 18:31:48,465 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/.tmp/rep_barrier/ffa2a8f71295483cba64c82ba5d6eb85 as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/rep_barrier/ffa2a8f71295483cba64c82ba5d6eb85 2023-07-12 18:31:48,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/cf1/3c4ff5c8be054161805dab9c5604fe55, entries=100, sequenceid=213, filesize=8.4 K 2023-07-12 18:31:48,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/.tmp/norep/430cdb5982624661b4ad4015ba6e8154 as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/norep/430cdb5982624661b4ad4015ba6e8154 2023-07-12 18:31:48,472 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/rep_barrier/ffa2a8f71295483cba64c82ba5d6eb85, entries=2, sequenceid=31, filesize=4.9 K 2023-07-12 18:31:48,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/norep/430cdb5982624661b4ad4015ba6e8154, entries=1, sequenceid=213, filesize=4.8 K 2023-07-12 18:31:48,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.44 KB/3521, heapSize ~11.52 KB/11800, currentSize=0 B/0 for 80b2b4fe906f78b38a7d69ad08dadb13 in 75ms, sequenceid=213, compaction requested=false 2023-07-12 18:31:48,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.95 KB/3018, heapSize ~5.34 KB/5464, currentSize=0 B/0 for 1588230740 in 81ms, sequenceid=31, compaction requested=false 2023-07-12 18:31:48,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/recovered.edits/216.seqid, newMaxSeqId=216, maxSeqId=109 2023-07-12 18:31:48,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:48,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 80b2b4fe906f78b38a7d69ad08dadb13: 2023-07-12 18:31:48,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed t1_syncup,,1689186677719.80b2b4fe906f78b38a7d69ad08dadb13. 2023-07-12 18:31:48,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 93e6956722d05ec4972c3a5270b9ac18, disabling compactions & flushes 2023-07-12 18:31:48,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:48,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:48,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. after waiting 0 ms 2023-07-12 18:31:48,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:48,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 93e6956722d05ec4972c3a5270b9ac18 2/2 column families, dataSize=7.05 KB heapSize=22.49 KB 2023-07-12 18:31:48,523 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/meta/1588230740/recovered.edits/34.seqid, newMaxSeqId=34, maxSeqId=22 2023-07-12 18:31:48,524 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 18:31:48,524 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 18:31:48,524 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 18:31:48,524 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 18:31:48,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=7.01 KB at sequenceid=413 (bloomFilter=true), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/.tmp/cf1/3bb5861eb66b46acbfc6ff8d42321208 2023-07-12 18:31:48,551 WARN [RS:0;jenkins-hbase20:39045.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.ReplicationSinkManager(154): No sinks available at peer. Will not be able to replicate 2023-07-12 18:31:48,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=41 B at sequenceid=413 (bloomFilter=true), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/.tmp/norep/7c1103dd051b4e17b128165f45dda4bc 2023-07-12 18:31:48,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/.tmp/cf1/3bb5861eb66b46acbfc6ff8d42321208 as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/cf1/3bb5861eb66b46acbfc6ff8d42321208 2023-07-12 18:31:48,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/cf1/3bb5861eb66b46acbfc6ff8d42321208, entries=200, sequenceid=413, filesize=12.5 K 2023-07-12 18:31:48,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/.tmp/norep/7c1103dd051b4e17b128165f45dda4bc as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/norep/7c1103dd051b4e17b128165f45dda4bc 2023-07-12 18:31:48,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/norep/7c1103dd051b4e17b128165f45dda4bc, entries=1, sequenceid=413, filesize=4.8 K 2023-07-12 18:31:48,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~7.05 KB/7221, heapSize ~22.46 KB/23000, currentSize=0 B/0 for 93e6956722d05ec4972c3a5270b9ac18 in 60ms, sequenceid=413, compaction requested=false 2023-07-12 18:31:48,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/default/t2_syncup/93e6956722d05ec4972c3a5270b9ac18/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=209 2023-07-12 18:31:48,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:48,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 93e6956722d05ec4972c3a5270b9ac18: 2023-07-12 18:31:48,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed t2_syncup,,1689186678359.93e6956722d05ec4972c3a5270b9ac18. 2023-07-12 18:31:48,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 340cf179e3faa54372c069aa2490aad9, disabling compactions & flushes 2023-07-12 18:31:48,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:48,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:48,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. after waiting 0 ms 2023-07-12 18:31:48,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:48,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/data/hbase/namespace/340cf179e3faa54372c069aa2490aad9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=9 2023-07-12 18:31:48,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:48,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 340cf179e3faa54372c069aa2490aad9: 2023-07-12 18:31:48,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689186674154.340cf179e3faa54372c069aa2490aad9. 2023-07-12 18:31:48,604 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,39045,1689186701549; all regions closed. 2023-07-12 18:31:48,609 DEBUG [RS:0;jenkins-hbase20:39045] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs 2023-07-12 18:31:48,609 INFO [RS:0;jenkins-hbase20:39045] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C39045%2C1689186701549.meta:.meta(num 1689186702203) 2023-07-12 18:31:48,614 DEBUG [RS:0;jenkins-hbase20:39045] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs 2023-07-12 18:31:48,614 INFO [RS:0;jenkins-hbase20:39045] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C39045%2C1689186701549:(num 1689186702074) 2023-07-12 18:31:48,614 DEBUG [RS:0;jenkins-hbase20:39045] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:48,614 INFO [RS:0;jenkins-hbase20:39045] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:31:48,614 INFO [RS:0;jenkins-hbase20:39045] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 18:31:48,614 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:48,615 INFO [RS:0;jenkins-hbase20:39045] regionserver.ReplicationSource(656): peerId=1, Closing source 1 because: Region server is closing 2023-07-12 18:31:48,800 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0030, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:48,800 DEBUG [RS:0;jenkins-hbase20:39045] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d45ac34 to 127.0.0.1:64028 2023-07-12 18:31:48,800 DEBUG [RS:0;jenkins-hbase20:39045] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:48,800 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0030, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:48,851 WARN [RS:0;jenkins-hbase20:39045.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.HBaseInterClusterReplicationEndpoint(515): No replication sinks found, returning without replicating. The source should retry with the same set of edits. Not logging this again for the next 10 seconds. 2023-07-12 18:31:48,901 DEBUG [RS:0;jenkins-hbase20:39045.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1] regionserver.HBaseInterClusterReplicationEndpoint(243): No sinks available at peer [Source for peer 1]: Interrupted while sleeping between retries 2023-07-12 18:31:48,901 INFO [RS:0;jenkins-hbase20:39045] regionserver.ReplicationSource(710): peerId=1, ReplicationSourceWorker RS:0;jenkins-hbase20:39045.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1 terminated 2023-07-12 18:31:48,903 INFO [RS:0;jenkins-hbase20:39045] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:39045 2023-07-12 18:31:48,905 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/rs 2023-07-12 18:31:48,905 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1008273886f002c, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/rs/jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:31:48,905 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1008273886f002c, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1/rs 2023-07-12 18:31:48,906 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,39045,1689186701549] 2023-07-12 18:31:48,906 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,39045,1689186701549; numProcessing=1 2023-07-12 18:31:48,906 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /1/draining/jenkins-hbase20.apache.org,39045,1689186701549 already deleted, retry=false 2023-07-12 18:31:48,906 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,39045,1689186701549 expired; onlineServers=0 2023-07-12 18:31:48,906 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,36461,1689186701487' ***** 2023-07-12 18:31:48,906 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 18:31:48,907 DEBUG [M:0;jenkins-hbase20:36461] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1024b956, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:48,908 INFO [M:0;jenkins-hbase20:36461] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,36461,1689186701487 2023-07-12 18:31:48,908 INFO [M:0;jenkins-hbase20:36461] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,36461,1689186701487; all regions closed. 2023-07-12 18:31:48,908 DEBUG [M:0;jenkins-hbase20:36461] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:48,908 DEBUG [M:0;jenkins-hbase20:36461] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 18:31:48,908 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 18:31:48,908 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186701860] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186701860,5,FailOnTimeoutGroup] 2023-07-12 18:31:48,908 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186701860] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186701860,5,FailOnTimeoutGroup] 2023-07-12 18:31:48,908 DEBUG [M:0;jenkins-hbase20:36461] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 18:31:48,910 INFO [M:0;jenkins-hbase20:36461] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 18:31:48,910 INFO [M:0;jenkins-hbase20:36461] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 18:31:48,910 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/master 2023-07-12 18:31:48,910 INFO [M:0;jenkins-hbase20:36461] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-07-12 18:31:48,910 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/1 2023-07-12 18:31:48,910 DEBUG [M:0;jenkins-hbase20:36461] master.HMaster(1512): Stopping service threads 2023-07-12 18:31:48,910 INFO [M:0;jenkins-hbase20:36461] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 18:31:48,911 ERROR [M:0;jenkins-hbase20:36461] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 18:31:48,911 INFO [M:0;jenkins-hbase20:36461] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 18:31:48,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Set watcher on znode that does not yet exist, /1/master 2023-07-12 18:31:48,911 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 18:31:48,912 DEBUG [M:0;jenkins-hbase20:36461] zookeeper.ZKUtil(398): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Unable to get data of znode /1/master because node does not exist (not an error) 2023-07-12 18:31:48,912 WARN [M:0;jenkins-hbase20:36461] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 18:31:48,912 INFO [M:0;jenkins-hbase20:36461] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 18:31:48,912 INFO [M:0;jenkins-hbase20:36461] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 18:31:48,914 DEBUG [M:0;jenkins-hbase20:36461] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 18:31:48,914 INFO [M:0;jenkins-hbase20:36461] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:48,914 DEBUG [M:0;jenkins-hbase20:36461] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:48,914 DEBUG [M:0;jenkins-hbase20:36461] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 18:31:48,915 DEBUG [M:0;jenkins-hbase20:36461] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:48,915 INFO [M:0;jenkins-hbase20:36461] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=29.77 KB heapSize=37.01 KB 2023-07-12 18:31:48,928 INFO [M:0;jenkins-hbase20:36461] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=29.77 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d68f5b8bd71d4eb0880e3e8bf5dd415e 2023-07-12 18:31:48,934 DEBUG [M:0;jenkins-hbase20:36461] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d68f5b8bd71d4eb0880e3e8bf5dd415e as hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d68f5b8bd71d4eb0880e3e8bf5dd415e 2023-07-12 18:31:48,941 INFO [M:0;jenkins-hbase20:36461] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d68f5b8bd71d4eb0880e3e8bf5dd415e, entries=10, sequenceid=218, filesize=5.8 K 2023-07-12 18:31:48,941 INFO [M:0;jenkins-hbase20:36461] regionserver.HRegion(2948): Finished flush of dataSize ~29.77 KB/30481, heapSize ~36.99 KB/37880, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=218, compaction requested=false 2023-07-12 18:31:48,944 INFO [M:0;jenkins-hbase20:36461] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:31:48,944 DEBUG [M:0;jenkins-hbase20:36461] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:31:48,948 INFO [M:0;jenkins-hbase20:36461] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 18:31:48,948 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:31:48,949 INFO [M:0;jenkins-hbase20:36461] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36461 2023-07-12 18:31:48,954 DEBUG [M:0;jenkins-hbase20:36461] zookeeper.RecoverableZooKeeper(172): Node /1/rs/jenkins-hbase20.apache.org,36461,1689186701487 already deleted, retry=false 2023-07-12 18:31:49,006 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1008273886f002c, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:49,006 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1008273886f002c, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:49,006 INFO [RS:0;jenkins-hbase20:39045] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,39045,1689186701549; zookeeper connection closed. 2023-07-12 18:31:49,007 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@53c8d98d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@53c8d98d 2023-07-12 18:31:49,008 INFO [Listener at localhost.localdomain/40201] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-12 18:31:49,106 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:49,106 INFO [M:0;jenkins-hbase20:36461] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,36461,1689186701487; zookeeper connection closed. 2023-07-12 18:31:49,107 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1008273886f002b, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:31:49,110 INFO [Listener at localhost.localdomain/40201] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=18 2023-07-12 18:31:49,110 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:49,110 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:49,110 INFO [Listener at localhost.localdomain/40201] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:49,110 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:49,110 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:49,111 INFO [Listener at localhost.localdomain/40201] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:49,111 INFO [Listener at localhost.localdomain/40201] ipc.NettyRpcServer(120): Bind to /148.251.75.209:37655 2023-07-12 18:31:49,112 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:49,113 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:49,115 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37655 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:49,117 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:376550x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:49,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37655-0x1008273886f0033 connected 2023-07-12 18:31:49,121 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:31:49,121 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:49,122 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/acl 2023-07-12 18:31:49,122 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37655 2023-07-12 18:31:49,126 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37655 2023-07-12 18:31:49,127 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37655 2023-07-12 18:31:49,131 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37655 2023-07-12 18:31:49,131 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37655 2023-07-12 18:31:49,131 INFO [Listener at localhost.localdomain/40201] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27, hbase.cluster.distributed=false 2023-07-12 18:31:49,135 DEBUG [pool-640-thread-1] master.MetaRegionLocationCache(164): Updating meta znode for path /2/meta-region-server: INIT 2023-07-12 18:31:49,144 INFO [Listener at localhost.localdomain/40201] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=18 2023-07-12 18:31:49,144 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:49,145 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:49,145 INFO [Listener at localhost.localdomain/40201] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:31:49,145 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:31:49,145 INFO [Listener at localhost.localdomain/40201] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:31:49,145 INFO [Listener at localhost.localdomain/40201] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:31:49,145 INFO [Listener at localhost.localdomain/40201] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36857 2023-07-12 18:31:49,146 INFO [Listener at localhost.localdomain/40201] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:31:49,147 DEBUG [Listener at localhost.localdomain/40201] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:31:49,148 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:49,149 INFO [Listener at localhost.localdomain/40201] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:49,150 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36857 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:49,152 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:368570x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:49,153 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:368570x0, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:31:49,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36857-0x1008273886f0034 connected 2023-07-12 18:31:49,154 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:31:49,155 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ZKUtil(164): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/acl 2023-07-12 18:31:49,155 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36857 2023-07-12 18:31:49,155 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36857 2023-07-12 18:31:49,156 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36857 2023-07-12 18:31:49,156 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36857 2023-07-12 18:31:49,156 DEBUG [Listener at localhost.localdomain/40201] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36857 2023-07-12 18:31:49,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /2/backup-masters/jenkins-hbase20.apache.org,37655,1689186709109 2023-07-12 18:31:49,162 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/backup-masters 2023-07-12 18:31:49,162 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/backup-masters/jenkins-hbase20.apache.org,37655,1689186709109 2023-07-12 18:31:49,163 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/master 2023-07-12 18:31:49,163 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/master 2023-07-12 18:31:49,163 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:49,165 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/master 2023-07-12 18:31:49,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/master 2023-07-12 18:31:49,165 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /2/backup-masters/jenkins-hbase20.apache.org,37655,1689186709109 from backup master directory 2023-07-12 18:31:49,166 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/backup-masters/jenkins-hbase20.apache.org,37655,1689186709109 2023-07-12 18:31:49,166 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/backup-masters 2023-07-12 18:31:49,166 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:49,166 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,37655,1689186709109 2023-07-12 18:31:49,182 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:31:49,202 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x374ec826 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:49,212 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77c7d09b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:49,213 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:31:49,214 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 18:31:49,214 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:49,222 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(288): Renamed hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41187,1689186684595 to hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41187,1689186684595-dead as it is dead 2023-07-12 18:31:49,223 INFO [master/jenkins-hbase20:0:becomeActiveMaster] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41187,1689186684595-dead/jenkins-hbase20.apache.org%2C41187%2C1689186684595.1689186684751 2023-07-12 18:31:49,223 INFO [master/jenkins-hbase20:0:becomeActiveMaster] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41187,1689186684595-dead/jenkins-hbase20.apache.org%2C41187%2C1689186684595.1689186684751 after 0ms 2023-07-12 18:31:49,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(300): Renamed hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41187,1689186684595-dead/jenkins-hbase20.apache.org%2C41187%2C1689186684595.1689186684751 to hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C41187%2C1689186684595.1689186684751 2023-07-12 18:31:49,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(302): Delete empty local region wal dir hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,41187,1689186684595-dead 2023-07-12 18:31:49,225 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,37655,1689186709109 2023-07-12 18:31:49,228 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37655%2C1689186709109, suffix=, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,37655,1689186709109, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/oldWALs, maxLogs=10 2023-07-12 18:31:49,244 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK] 2023-07-12 18:31:49,244 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK] 2023-07-12 18:31:49,244 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK] 2023-07-12 18:31:49,246 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/WALs/jenkins-hbase20.apache.org,37655,1689186709109/jenkins-hbase20.apache.org%2C37655%2C1689186709109.1689186709228 2023-07-12 18:31:49,247 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK], DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK], DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK]] 2023-07-12 18:31:49,247 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:49,247 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:49,247 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:49,247 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:49,249 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:49,250 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 18:31:49,250 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 18:31:49,256 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5757662de28b4a8085ebee26abdc1c0c 2023-07-12 18:31:49,260 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/80dbbba6247c4a9e9f59203ae7d16923 2023-07-12 18:31:49,260 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:49,260 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5179): Found 1 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals 2023-07-12 18:31:49,260 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5276): Replaying edits from hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C41187%2C1689186684595.1689186684751 2023-07-12 18:31:49,264 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5464): Applied 0, skipped 117, firstSequenceIdInLog=120, maxSequenceIdInLog=221, path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C41187%2C1689186684595.1689186684751 2023-07-12 18:31:49,265 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase20.apache.org%2C41187%2C1689186684595.1689186684751 2023-07-12 18:31:49,269 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:31:49,271 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/221.seqid, newMaxSeqId=221, maxSeqId=118 2023-07-12 18:31:49,272 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=222; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73704511, jitterRate=0.09828279912471771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:31:49,272 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:31:49,274 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 18:31:49,275 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 18:31:49,275 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 18:31:49,275 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 18:31:49,276 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-12 18:31:49,282 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-12 18:31:49,282 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-12 18:31:49,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-12 18:31:49,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-12 18:31:49,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=t1_syncup 2023-07-12 18:31:49,284 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=12, state=SUCCESS; CreateTableProcedure table=t2_syncup 2023-07-12 18:31:49,284 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=15, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,34681,1689186676059, splitWal=true, meta=false 2023-07-12 18:31:49,284 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=16, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,42439,1689186676093, splitWal=true, meta=true 2023-07-12 18:31:49,284 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=17, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,41549,1689186676122, splitWal=true, meta=false 2023-07-12 18:31:49,284 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=18, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,34413,1689186676157, splitWal=true, meta=false 2023-07-12 18:31:49,285 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 8 msec 2023-07-12 18:31:49,285 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 18:31:49,286 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-12 18:31:49,286 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase20.apache.org,38715,1689186684627, table=hbase:meta, region=1588230740 2023-07-12 18:31:49,288 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 1 possibly 'live' servers, and 0 'splitting'. 2023-07-12 18:31:49,289 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.RecoverableZooKeeper(172): Node /2/draining/jenkins-hbase20.apache.org,38715,1689186684627 already deleted, retry=false 2023-07-12 18:31:49,289 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(568): Processing expiration of jenkins-hbase20.apache.org,38715,1689186684627 on jenkins-hbase20.apache.org,37655,1689186709109 2023-07-12 18:31:49,290 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase20.apache.org,38715,1689186684627, splitWal=true, meta=true 2023-07-12 18:31:49,290 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=27 for jenkins-hbase20.apache.org,38715,1689186684627 (carryingMeta=true) jenkins-hbase20.apache.org,38715,1689186684627/CRASHED/regionCount=1/lock=java.util.concurrent.locks.ReentrantReadWriteLock@6abdb454[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-12 18:31:49,299 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 18:31:49,299 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 18:31:49,300 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/balancer 2023-07-12 18:31:49,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 18:31:49,300 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/normalizer 2023-07-12 18:31:49,301 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/switch/split 2023-07-12 18:31:49,301 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/switch/merge 2023-07-12 18:31:49,302 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/snapshot-cleanup 2023-07-12 18:31:49,304 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/running 2023-07-12 18:31:49,304 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/2/running 2023-07-12 18:31:49,304 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:31:49,305 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,37655,1689186709109, sessionid=0x1008273886f0033, setting cluster-up flag (Was=false) 2023-07-12 18:31:49,313 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /2/flush-table-proc/acquired, /2/flush-table-proc/reached, /2/flush-table-proc/abort 2023-07-12 18:31:49,314 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,37655,1689186709109 2023-07-12 18:31:49,316 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /2/online-snapshot/acquired, /2/online-snapshot/reached, /2/online-snapshot/abort 2023-07-12 18:31:49,323 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,37655,1689186709109 2023-07-12 18:31:49,323 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/.hbase-snapshot/.tmp 2023-07-12 18:31:49,325 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:49,325 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:49,325 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:49,325 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:31:49,325 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-07-12 18:31:49,325 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:49,325 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:49,325 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:49,332 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689186739332 2023-07-12 18:31:49,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 18:31:49,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 18:31:49,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 18:31:49,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 18:31:49,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 18:31:49,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 18:31:49,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:49,334 DEBUG [PEWorker-1] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38715,1689186684627; numProcessing=1 2023-07-12 18:31:49,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 18:31:49,334 INFO [PEWorker-1] procedure.ServerCrashProcedure(161): Start pid=27, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,38715,1689186684627, splitWal=true, meta=true 2023-07-12 18:31:49,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 18:31:49,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 18:31:49,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 18:31:49,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 18:31:49,335 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186709334,5,FailOnTimeoutGroup] 2023-07-12 18:31:49,335 INFO [PEWorker-1] procedure.ServerCrashProcedure(300): Splitting WALs pid=27, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,38715,1689186684627, splitWal=true, meta=true, isMeta: true 2023-07-12 18:31:49,337 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186709335,5,FailOnTimeoutGroup] 2023-07-12 18:31:49,338 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:49,338 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 18:31:49,338 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:49,338 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:49,338 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689186709338, completionTime=-1 2023-07-12 18:31:49,338 WARN [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(766): The value of 'hbase.master.wait.on.regionservers.maxtostart' (-1) is set less than 'hbase.master.wait.on.regionservers.mintostart' (1), ignoring. 2023-07-12 18:31:49,338 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=0; waited=0ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=0ms 2023-07-12 18:31:49,339 DEBUG [PEWorker-1] master.MasterWalManager(318): Renamed region directory: hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,38715,1689186684627-splitting 2023-07-12 18:31:49,340 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,38715,1689186684627-splitting dir is empty, no logs to split. 2023-07-12 18:31:49,340 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,38715,1689186684627 WAL count=0, meta=true 2023-07-12 18:31:49,342 INFO [PEWorker-1] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,38715,1689186684627-splitting dir is empty, no logs to split. 2023-07-12 18:31:49,342 INFO [PEWorker-1] master.SplitWALManager(106): jenkins-hbase20.apache.org,38715,1689186684627 WAL count=0, meta=true 2023-07-12 18:31:49,342 DEBUG [PEWorker-1] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,38715,1689186684627 WAL splitting is done? wals=0, meta=true 2023-07-12 18:31:49,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 18:31:49,344 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 18:31:49,345 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:49,357 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(951): ClusterId : 3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:49,358 DEBUG [RS:0;jenkins-hbase20:36857] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:31:49,359 DEBUG [RS:0;jenkins-hbase20:36857] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:31:49,359 DEBUG [RS:0;jenkins-hbase20:36857] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:31:49,361 DEBUG [RS:0;jenkins-hbase20:36857] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:31:49,363 DEBUG [RS:0;jenkins-hbase20:36857] zookeeper.ReadOnlyZKClient(139): Connect 0x38e3b82d to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:49,372 DEBUG [RS:0;jenkins-hbase20:36857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36245141, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:49,372 DEBUG [RS:0;jenkins-hbase20:36857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@321bd35d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:31:49,382 DEBUG [RS:0;jenkins-hbase20:36857] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:36857 2023-07-12 18:31:49,382 INFO [RS:0;jenkins-hbase20:36857] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:31:49,382 INFO [RS:0;jenkins-hbase20:36857] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:31:49,382 DEBUG [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:31:49,383 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,37655,1689186709109 with isa=jenkins-hbase20.apache.org/148.251.75.209:36857, startcode=1689186709144 2023-07-12 18:31:49,383 DEBUG [RS:0;jenkins-hbase20:36857] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:31:49,384 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50709, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:31:49,385 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37655] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:49,386 DEBUG [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27 2023-07-12 18:31:49,386 DEBUG [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:41891 2023-07-12 18:31:49,386 DEBUG [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:31:49,387 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f002a, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:49,387 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:49,387 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:31:49,387 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0027, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:31:49,387 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:31:49,387 DEBUG [RS:0;jenkins-hbase20:36857] zookeeper.ZKUtil(162): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:49,388 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=1; waited=50ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=0ms 2023-07-12 18:31:49,388 WARN [RS:0;jenkins-hbase20:36857] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:31:49,388 INFO [RS:0;jenkins-hbase20:36857] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:49,389 DEBUG [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:49,389 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,36857,1689186709144] 2023-07-12 18:31:49,392 DEBUG [RS:0;jenkins-hbase20:36857] zookeeper.ZKUtil(162): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/rs/jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:49,393 DEBUG [RS:0;jenkins-hbase20:36857] regionserver.Replication(139): Replication stats-in-log period=5 seconds 2023-07-12 18:31:49,393 INFO [RS:0;jenkins-hbase20:36857] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:31:49,394 INFO [RS:0;jenkins-hbase20:36857] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:31:49,398 INFO [RS:0;jenkins-hbase20:36857] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:31:49,399 INFO [RS:0;jenkins-hbase20:36857] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:49,399 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:31:49,401 INFO [RS:0;jenkins-hbase20:36857] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:49,401 DEBUG [RS:0;jenkins-hbase20:36857] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:49,401 DEBUG [RS:0;jenkins-hbase20:36857] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:49,401 DEBUG [RS:0;jenkins-hbase20:36857] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:49,401 DEBUG [RS:0;jenkins-hbase20:36857] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:49,401 DEBUG [RS:0;jenkins-hbase20:36857] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:49,401 DEBUG [RS:0;jenkins-hbase20:36857] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:31:49,401 DEBUG [RS:0;jenkins-hbase20:36857] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:49,401 DEBUG [RS:0;jenkins-hbase20:36857] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:49,401 DEBUG [RS:0;jenkins-hbase20:36857] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:49,401 DEBUG [RS:0;jenkins-hbase20:36857] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:31:49,402 INFO [RS:0;jenkins-hbase20:36857] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:49,403 INFO [RS:0;jenkins-hbase20:36857] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:49,403 INFO [RS:0;jenkins-hbase20:36857] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:49,413 INFO [RS:0;jenkins-hbase20:36857] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:31:49,413 INFO [RS:0;jenkins-hbase20:36857] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36857,1689186709144-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:49,422 INFO [RS:0;jenkins-hbase20:36857] regionserver.Replication(203): jenkins-hbase20.apache.org,36857,1689186709144 started 2023-07-12 18:31:49,422 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,36857,1689186709144, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:36857, sessionid=0x1008273886f0034 2023-07-12 18:31:49,422 DEBUG [RS:0;jenkins-hbase20:36857] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:31:49,422 DEBUG [RS:0;jenkins-hbase20:36857] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:49,422 DEBUG [RS:0;jenkins-hbase20:36857] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36857,1689186709144' 2023-07-12 18:31:49,422 DEBUG [RS:0;jenkins-hbase20:36857] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/flush-table-proc/abort' 2023-07-12 18:31:49,422 DEBUG [RS:0;jenkins-hbase20:36857] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/flush-table-proc/acquired' 2023-07-12 18:31:49,423 DEBUG [RS:0;jenkins-hbase20:36857] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:31:49,423 DEBUG [RS:0;jenkins-hbase20:36857] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:31:49,423 DEBUG [RS:0;jenkins-hbase20:36857] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:49,423 DEBUG [RS:0;jenkins-hbase20:36857] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36857,1689186709144' 2023-07-12 18:31:49,423 DEBUG [RS:0;jenkins-hbase20:36857] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/2/online-snapshot/abort' 2023-07-12 18:31:49,423 DEBUG [RS:0;jenkins-hbase20:36857] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/2/online-snapshot/acquired' 2023-07-12 18:31:49,424 DEBUG [RS:0;jenkins-hbase20:36857] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:31:49,424 INFO [RS:0;jenkins-hbase20:36857] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:31:49,424 INFO [RS:0;jenkins-hbase20:36857] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:31:49,495 DEBUG [jenkins-hbase20:37655] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-12 18:31:49,497 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36857,1689186709144, state=OPENING 2023-07-12 18:31:49,499 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/2/meta-region-server 2023-07-12 18:31:49,499 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /2/meta-region-server: CHANGED 2023-07-12 18:31:49,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36857,1689186709144}] 2023-07-12 18:31:49,526 INFO [RS:0;jenkins-hbase20:36857] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36857%2C1689186709144, suffix=, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,36857,1689186709144, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs, maxLogs=10 2023-07-12 18:31:49,538 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK] 2023-07-12 18:31:49,538 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK] 2023-07-12 18:31:49,538 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK] 2023-07-12 18:31:49,544 INFO [RS:0;jenkins-hbase20:36857] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,36857,1689186709144/jenkins-hbase20.apache.org%2C36857%2C1689186709144.1689186709526 2023-07-12 18:31:49,544 DEBUG [RS:0;jenkins-hbase20:36857] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK], DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK], DatanodeInfoWithStorage[127.0.0.1:38461,DS-46e2b732-ffcf-4808-935e-a4b02799b3ad,DISK]] 2023-07-12 18:31:49,656 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:49,656 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:31:49,658 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:31:49,661 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 18:31:49,662 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:49,664 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36857%2C1689186709144.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,36857,1689186709144, archiveDir=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs, maxLogs=10 2023-07-12 18:31:49,677 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK] 2023-07-12 18:31:49,677 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK] 2023-07-12 18:31:49,677 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK] 2023-07-12 18:31:49,680 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,36857,1689186709144/jenkins-hbase20.apache.org%2C36857%2C1689186709144.meta.1689186709664.meta 2023-07-12 18:31:49,682 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45547,DS-db7fde66-ad4c-4a48-8535-352b6bbf8ec5,DISK], DatanodeInfoWithStorage[127.0.0.1:34087,DS-cba59fba-6c7c-4bdb-b072-58d23d9e46e3,DISK], DatanodeInfoWithStorage[127.0.0.1:38743,DS-5a8fb617-10b4-4101-bbc9-34c11c22c28b,DISK]] 2023-07-12 18:31:49,683 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:49,683 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 18:31:49,683 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 18:31:49,683 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 18:31:49,683 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 18:31:49,683 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:49,683 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 18:31:49,683 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 18:31:49,685 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 18:31:49,686 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info 2023-07-12 18:31:49,686 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info 2023-07-12 18:31:49,686 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 18:31:49,695 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info/713a0feaf4e4481298e78a8b6112e9f1 2023-07-12 18:31:49,699 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info/7f70654f679f470fae2ba97cc73e6aef 2023-07-12 18:31:49,699 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:49,700 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 18:31:49,700 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:49,701 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:31:49,701 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 18:31:49,701 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:49,701 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 18:31:49,702 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/table 2023-07-12 18:31:49,702 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/table 2023-07-12 18:31:49,702 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 18:31:49,708 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/table/d68a2991dfeb4319a19d0b56203be4d4 2023-07-12 18:31:49,708 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:49,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740 2023-07-12 18:31:49,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740 2023-07-12 18:31:49,713 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 18:31:49,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 18:31:49,716 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=35; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60592797, jitterRate=-0.09709696471691132}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 18:31:49,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 18:31:49,716 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=29, masterSystemTime=1689186709656 2023-07-12 18:31:49,722 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 18:31:49,723 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 18:31:49,723 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36857,1689186709144, state=OPEN 2023-07-12 18:31:49,724 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/2/meta-region-server 2023-07-12 18:31:49,726 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /2/meta-region-server: CHANGED 2023-07-12 18:31:49,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=28 2023-07-12 18:31:49,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=28, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36857,1689186709144 in 226 msec 2023-07-12 18:31:49,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-12 18:31:49,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 385 msec 2023-07-12 18:31:50,892 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=1; waited=1554ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=1504ms 2023-07-12 18:31:52,087 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 18:31:52,395 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(801): Waiting on regionserver count=1; waited=3057ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=3007ms 2023-07-12 18:31:53,849 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=4511ms, expected min=1 server(s), max=NO_LIMIT server(s), master is running 2023-07-12 18:31:53,849 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 18:31:53,853 DEBUG [hconnection-0x21984926-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:53,854 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:53,865 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=63272e89b8aafccb1ffb2f93ed48b12c, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,38715,1689186684627, regionLocation=jenkins-hbase20.apache.org,38715,1689186684627, openSeqNum=10 2023-07-12 18:31:53,865 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=e22f590dd8a98a0fba12251b93336902, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,38715,1689186684627, regionLocation=jenkins-hbase20.apache.org,38715,1689186684627, openSeqNum=11 2023-07-12 18:31:53,865 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=bde3b0e33054f5210b7a78be27604e3f, regionState=OPEN, lastHost=jenkins-hbase20.apache.org,38715,1689186684627, regionLocation=jenkins-hbase20.apache.org,38715,1689186684627, openSeqNum=12 2023-07-12 18:31:53,865 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-12 18:31:53,865 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689186773865 2023-07-12 18:31:53,865 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689186833865 2023-07-12 18:31:53,865 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 16 msec 2023-07-12 18:31:53,881 INFO [PEWorker-3] procedure.ServerCrashProcedure(199): jenkins-hbase20.apache.org,38715,1689186684627 had 4 regions 2023-07-12 18:31:53,881 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37655,1689186709109-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:53,881 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37655,1689186709109-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:53,881 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37655,1689186709109-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:53,882 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:37655, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:53,882 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 18:31:53,882 WARN [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1240): hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. is NOT online; state={63272e89b8aafccb1ffb2f93ed48b12c state=OPEN, ts=1689186713865, server=jenkins-hbase20.apache.org,38715,1689186684627}; ServerCrashProcedures=true. Master startup cannot progress, in holding-pattern until region onlined. 2023-07-12 18:31:53,883 INFO [PEWorker-3] procedure.ServerCrashProcedure(300): Splitting WALs pid=27, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase20.apache.org,38715,1689186684627, splitWal=true, meta=true, isMeta: false 2023-07-12 18:31:53,885 INFO [PEWorker-3] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,38715,1689186684627-splitting dir is empty, no logs to split. 2023-07-12 18:31:53,885 INFO [PEWorker-3] master.SplitWALManager(106): jenkins-hbase20.apache.org,38715,1689186684627 WAL count=0, meta=false 2023-07-12 18:31:53,887 WARN [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(172): unknown_server=jenkins-hbase20.apache.org,38715,1689186684627/hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c., unknown_server=jenkins-hbase20.apache.org,38715,1689186684627/t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902., unknown_server=jenkins-hbase20.apache.org,38715,1689186684627/t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:53,889 INFO [PEWorker-3] master.SplitLogManager(171): hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/WALs/jenkins-hbase20.apache.org,38715,1689186684627-splitting dir is empty, no logs to split. 2023-07-12 18:31:53,889 INFO [PEWorker-3] master.SplitWALManager(106): jenkins-hbase20.apache.org,38715,1689186684627 WAL count=0, meta=false 2023-07-12 18:31:53,889 DEBUG [PEWorker-3] procedure.ServerCrashProcedure(290): Check if jenkins-hbase20.apache.org,38715,1689186684627 WAL splitting is done? wals=0, meta=false 2023-07-12 18:31:53,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN}, {pid=31, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN}, {pid=32, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN}] 2023-07-12 18:31:53,893 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=31, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN 2023-07-12 18:31:53,893 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN 2023-07-12 18:31:53,893 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN 2023-07-12 18:31:53,894 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=31, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:53,894 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=32, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:53,894 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2023-07-12 18:31:53,895 DEBUG [jenkins-hbase20:37655] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-12 18:31:53,898 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=e22f590dd8a98a0fba12251b93336902, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:53,899 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186713898"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186713898"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186713898"}]},"ts":"1689186713898"} 2023-07-12 18:31:53,899 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=bde3b0e33054f5210b7a78be27604e3f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:53,899 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=63272e89b8aafccb1ffb2f93ed48b12c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:53,899 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186713899"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186713899"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186713899"}]},"ts":"1689186713899"} 2023-07-12 18:31:53,899 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186713899"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689186713899"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689186713899"}]},"ts":"1689186713899"} 2023-07-12 18:31:53,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=31, state=RUNNABLE; OpenRegionProcedure e22f590dd8a98a0fba12251b93336902, server=jenkins-hbase20.apache.org,36857,1689186709144}] 2023-07-12 18:31:53,902 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=32, state=RUNNABLE; OpenRegionProcedure bde3b0e33054f5210b7a78be27604e3f, server=jenkins-hbase20.apache.org,36857,1689186709144}] 2023-07-12 18:31:53,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=35, ppid=30, state=RUNNABLE; OpenRegionProcedure 63272e89b8aafccb1ffb2f93ed48b12c, server=jenkins-hbase20.apache.org,36857,1689186709144}] 2023-07-12 18:31:54,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:54,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bde3b0e33054f5210b7a78be27604e3f, NAME => 't2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:54,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table t2_syncup bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:54,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:54,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:54,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:54,062 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:54,064 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:54,064 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1 2023-07-12 18:31:54,064 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1 2023-07-12 18:31:54,064 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 63272e89b8aafccb1ffb2f93ed48b12c, NAME => 'hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:54,065 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:54,065 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bde3b0e33054f5210b7a78be27604e3f columnFamilyName cf1 2023-07-12 18:31:54,065 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:54,065 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:54,065 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:54,069 INFO [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:54,071 DEBUG [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/info 2023-07-12 18:31:54,071 DEBUG [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/info 2023-07-12 18:31:54,071 INFO [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63272e89b8aafccb1ffb2f93ed48b12c columnFamilyName info 2023-07-12 18:31:54,075 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1/3a4b74c213ec46f7865410bb78e1144c 2023-07-12 18:31:54,076 DEBUG [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/info/1d076a2957f24c2c974ca0e26f8c2633 2023-07-12 18:31:54,076 INFO [StoreOpener-63272e89b8aafccb1ffb2f93ed48b12c-1] regionserver.HStore(310): Store=63272e89b8aafccb1ffb2f93ed48b12c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:54,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:54,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:54,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:31:54,082 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 63272e89b8aafccb1ffb2f93ed48b12c; next sequenceid=13; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74624844, jitterRate=0.11199682950973511}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:31:54,082 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 63272e89b8aafccb1ffb2f93ed48b12c: 2023-07-12 18:31:54,083 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c., pid=35, masterSystemTime=1689186714056 2023-07-12 18:31:54,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:54,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:31:54,086 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=63272e89b8aafccb1ffb2f93ed48b12c, regionState=OPEN, openSeqNum=13, regionLocation=jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:54,086 INFO [StoreFileOpener-cf1-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7545e7a02e30411892f652343fef209d 2023-07-12 18:31:54,086 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1/7545e7a02e30411892f652343fef209d 2023-07-12 18:31:54,086 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689186714086"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186714086"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186714086"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186714086"}]},"ts":"1689186714086"} 2023-07-12 18:31:54,086 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(310): Store=bde3b0e33054f5210b7a78be27604e3f/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:54,087 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family norep of region bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:54,088 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/norep 2023-07-12 18:31:54,088 DEBUG [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/norep 2023-07-12 18:31:54,088 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bde3b0e33054f5210b7a78be27604e3f columnFamilyName norep 2023-07-12 18:31:54,089 INFO [StoreOpener-bde3b0e33054f5210b7a78be27604e3f-1] regionserver.HStore(310): Store=bde3b0e33054f5210b7a78be27604e3f/norep, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:54,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=30 2023-07-12 18:31:54,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=30, state=SUCCESS; OpenRegionProcedure 63272e89b8aafccb1ffb2f93ed48b12c, server=jenkins-hbase20.apache.org,36857,1689186709144 in 186 msec 2023-07-12 18:31:54,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:54,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=63272e89b8aafccb1ffb2f93ed48b12c, ASSIGN in 199 msec 2023-07-12 18:31:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:54,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table t2_syncup descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 18:31:54,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:31:54,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bde3b0e33054f5210b7a78be27604e3f; next sequenceid=19; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68645078, jitterRate=0.022891372442245483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 18:31:54,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bde3b0e33054f5210b7a78be27604e3f: 2023-07-12 18:31:54,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f., pid=34, masterSystemTime=1689186714056 2023-07-12 18:31:54,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:54,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:31:54,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:54,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e22f590dd8a98a0fba12251b93336902, NAME => 't1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:31:54,096 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=bde3b0e33054f5210b7a78be27604e3f, regionState=OPEN, openSeqNum=19, regionLocation=jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:54,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table t1_syncup e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:54,096 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186714096"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186714096"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186714096"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186714096"}]},"ts":"1689186714096"} 2023-07-12 18:31:54,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:31:54,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:54,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:54,098 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:54,098 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1 2023-07-12 18:31:54,099 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1 2023-07-12 18:31:54,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=34, resume processing ppid=32 2023-07-12 18:31:54,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=32, state=SUCCESS; OpenRegionProcedure bde3b0e33054f5210b7a78be27604e3f, server=jenkins-hbase20.apache.org,36857,1689186709144 in 195 msec 2023-07-12 18:31:54,099 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e22f590dd8a98a0fba12251b93336902 columnFamilyName cf1 2023-07-12 18:31:54,100 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=t2_syncup, region=bde3b0e33054f5210b7a78be27604e3f, ASSIGN in 209 msec 2023-07-12 18:31:54,105 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1/ca6edfd8870545488777f98352cb93e2 2023-07-12 18:31:54,110 INFO [StoreFileOpener-cf1-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e605252f78384e43802c06099f8d418c 2023-07-12 18:31:54,110 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1/e605252f78384e43802c06099f8d418c 2023-07-12 18:31:54,111 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(310): Store=e22f590dd8a98a0fba12251b93336902/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:54,111 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family norep of region e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:54,112 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/norep 2023-07-12 18:31:54,112 DEBUG [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/norep 2023-07-12 18:31:54,113 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e22f590dd8a98a0fba12251b93336902 columnFamilyName norep 2023-07-12 18:31:54,113 INFO [StoreOpener-e22f590dd8a98a0fba12251b93336902-1] regionserver.HStore(310): Store=e22f590dd8a98a0fba12251b93336902/norep, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:31:54,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:54,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:54,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table t1_syncup descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-12 18:31:54,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:31:54,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e22f590dd8a98a0fba12251b93336902; next sequenceid=18; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71749128, jitterRate=0.0691453218460083}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-12 18:31:54,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e22f590dd8a98a0fba12251b93336902: 2023-07-12 18:31:54,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902., pid=33, masterSystemTime=1689186714056 2023-07-12 18:31:54,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:54,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:31:54,122 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=e22f590dd8a98a0fba12251b93336902, regionState=OPEN, openSeqNum=18, regionLocation=jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:31:54,122 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1689186714122"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689186714122"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689186714122"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689186714122"}]},"ts":"1689186714122"} 2023-07-12 18:31:54,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=31 2023-07-12 18:31:54,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=31, state=SUCCESS; OpenRegionProcedure e22f590dd8a98a0fba12251b93336902, server=jenkins-hbase20.apache.org,36857,1689186709144 in 222 msec 2023-07-12 18:31:54,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=27 2023-07-12 18:31:54,125 INFO [PEWorker-4] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase20.apache.org,38715,1689186684627 after splitting done 2023-07-12 18:31:54,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=t1_syncup, region=e22f590dd8a98a0fba12251b93336902, ASSIGN in 234 msec 2023-07-12 18:31:54,125 DEBUG [PEWorker-4] master.DeadServer(114): Removed jenkins-hbase20.apache.org,38715,1689186684627 from processing; numProcessing=0 2023-07-12 18:31:54,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; ServerCrashProcedure jenkins-hbase20.apache.org,38715,1689186684627, splitWal=true, meta=true in 4.8370 sec 2023-07-12 18:31:54,422 INFO [jenkins-hbase20:36857Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:54,884 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on existing znode=/2/namespace 2023-07-12 18:31:54,906 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/2/namespace/default 2023-07-12 18:31:54,907 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/2/namespace/hbase 2023-07-12 18:31:54,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 5.741sec 2023-07-12 18:31:54,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 18:31:54,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 18:31:54,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 18:31:54,907 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37655,1689186709109-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 18:31:54,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37655,1689186709109-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 18:31:54,910 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 18:31:54,964 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(139): Connect 0x2a5db71b to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:54,968 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27a4f0a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:54,969 DEBUG [hconnection-0x64918273-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:54,971 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:54,974 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(1262): HBase has been restarted 2023-07-12 18:31:54,974 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a5db71b to 127.0.0.1:64028 2023-07-12 18:31:54,974 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:31:54,976 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(2939): Invalidated connection. Updating master addresses before: jenkins-hbase20.apache.org:37655 after: jenkins-hbase20.apache.org:37655 2023-07-12 18:31:54,976 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(139): Connect 0x21aeb980 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:54,980 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49c425dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:55,394 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 't2_syncup' 2023-07-12 18:31:55,396 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 18:31:55,398 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 18:31:55,399 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 't1_syncup' 2023-07-12 18:31:55,484 DEBUG [hconnection-0x40722905-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:31:55,486 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:31:55,517 INFO [Listener at localhost.localdomain/40201] zookeeper.RecoverableZooKeeper(93): Process identifier=syncupReplication1689186715517 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:55,519 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): syncupReplication16891867155170x0, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:55,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): syncupReplication1689186715517-0x1008273886f0039 connected Start Replication Server start 2023-07-12 18:31:55,522 INFO [Listener at localhost.localdomain/40201] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:31:55,533 INFO [Listener at localhost.localdomain/40201] hbase.HBaseConfiguration(293): Overriding client registry implementation to org.apache.hadoop.hbase.client.ZKConnectionRegistry 2023-07-12 18:31:55,534 DEBUG [Listener at localhost.localdomain/40201] regionserver.Replication(139): Replication stats-in-log period=5 seconds 2023-07-12 18:31:55,544 INFO [Listener at localhost.localdomain/40201] regionserver.ReplicationSource(232): queueId=1, ReplicationSource: 1, currentBandwidth=0 2023-07-12 18:31:55,545 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager(266): Current list of replicators: [jenkins-hbase20.apache.org,39045,1689186701549] other RSs: [] 2023-07-12 18:31:55,564 DEBUG [Listener at localhost.localdomain/40201.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x015055cc to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:31:55,568 DEBUG [Listener at localhost.localdomain/40201.replicationSource,1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@4123774d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:31:55,568 INFO [Listener at localhost.localdomain/40201.replicationSource,1] zookeeper.RecoverableZooKeeper(93): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:31:55,569 DEBUG [Listener at localhost.localdomain/40201.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 10x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:31:55,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): connection to cluster: 1-0x1008273886f003b connected 2023-07-12 18:31:55,571 INFO [Listener at localhost.localdomain/40201.replicationSource,1] regionserver.ReplicationSource(586): peerId=1, queueId=1 (queues=0) is replicating from cluster=23c3b538-bf67-481b-8351-f0e7ae087693 to cluster=3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:31:58,041 INFO [ReplicationExecutor-0] replication.ZKReplicationQueueStorage(390): Atomically moving jenkins-hbase20.apache.org,39045,1689186701549/1's WALs to 1689186715522.syncuptool.replication.org,1234,1 2023-07-12 18:31:58,045 DEBUG [ReplicationExecutor-0] replication.ZKReplicationQueueStorage(415): Creating jenkins-hbase20.apache.org%2C39045%2C1689186701549.1689186702074 with data PBUF\x08\x8D\x09 2023-07-12 18:31:58,054 INFO [ReplicationExecutor-0] replication.ZKReplicationQueueStorage(433): Atomically moved jenkins-hbase20.apache.org,39045,1689186701549/1's WALs to 1689186715522.syncuptool.replication.org,1234,1 2023-07-12 18:31:59,422 INFO [jenkins-hbase20:36857Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:31:59,563 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 18:32:00,055 DEBUG [ReplicationExecutor-0] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,39045,1689186701549] 2023-07-12 18:32:00,056 DEBUG [ReplicationExecutor-0] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,39045,1689186701549] 2023-07-12 18:32:00,069 DEBUG [ReplicationExecutor-0] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,39045,1689186701549] 2023-07-12 18:32:00,069 INFO [ReplicationExecutor-0] regionserver.ReplicationSource(232): queueId=1-jenkins-hbase20.apache.org,39045,1689186701549, ReplicationSource: 1, currentBandwidth=0 2023-07-12 18:32:00,070 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager$NodeFailoverWorker(800): Added recovered source 1-jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:32:00,087 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549] zookeeper.ReadOnlyZKClient(139): Connect 0x3d7503d3 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:32:00,090 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@34f2e12a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:32:00,091 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549] zookeeper.RecoverableZooKeeper(93): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=127.0.0.1:64028 2023-07-12 18:32:00,092 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 10x0, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:32:00,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): connection to cluster: 1-0x1008273886f003d connected 2023-07-12 18:32:00,094 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.ReplicationSource(586): peerId=1, queueId=1-jenkins-hbase20.apache.org,39045,1689186701549 (queues=1) is replicating from cluster=23c3b538-bf67-481b-8351-f0e7ae087693 to cluster=3c9e3670-124b-43a3-a17d-92a5f963e15b 2023-07-12 18:32:00,094 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.ReplicationSource(346): peerId=1, starting shipping worker for walGroupId=jenkins-hbase20.apache.org%2C39045%2C1689186701549 2023-07-12 18:32:00,098 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.ReplicationSourceWALReader(119): peerClusterZnode=1-jenkins-hbase20.apache.org,39045,1689186701549, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2023-07-12 18:32:00,099 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.ReplicationSourceShipper(98): Running ReplicationSourceShipper Thread for wal group: jenkins-hbase20.apache.org%2C39045%2C1689186701549 2023-07-12 18:32:00,113 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.WALEntryStream(248): EOF, closing hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs/jenkins-hbase20.apache.org%2C39045%2C1689186701549.1689186702074 2023-07-12 18:32:00,113 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.ReplicationSourceWALReader(162): Read 300 WAL entries eligible for replication 2023-07-12 18:32:00,113 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549.replicationSource.wal-reader.jenkins-hbase20.apache.org%2C39045%2C1689186701549,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.ReplicationSourceWALReader(247): Stopping the replication source wal reader 2023-07-12 18:32:00,116 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.ReplicationSourceShipper(110): Shipper from source 1-jenkins-hbase20.apache.org,39045,1689186701549 got entry batch from reader: WALEntryBatch [walEntries=[{t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/112=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/113=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/114=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/115=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/116=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/117=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/118=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/119=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/120=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/121=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/122=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/123=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/124=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/125=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/126=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/127=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/128=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/129=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/130=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/131=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/132=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/133=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/134=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/135=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/136=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/137=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/138=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/139=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/140=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/141=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/142=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/143=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/144=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/145=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/146=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/147=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/148=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/149=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/150=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/151=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/152=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/153=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/154=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/155=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/156=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/157=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/158=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/159=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/160=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/161=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/162=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/163=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/164=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/165=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/166=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/167=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/168=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/169=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/170=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/171=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/172=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/173=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/174=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/175=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/176=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/177=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/178=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/179=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/180=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/181=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/182=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/183=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/184=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/185=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/186=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/187=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/188=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/189=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/190=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/191=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/192=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/193=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/194=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/195=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/196=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/197=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/198=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/199=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/200=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/201=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/202=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/203=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/204=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/205=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/206=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/207=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/208=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/209=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/210=[#edits: 1 = ],208}, {t1_syncup/80b2b4fe906f78b38a7d69ad08dadb13/211=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/212=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/213=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/214=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/215=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/216=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/217=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/218=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/219=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/220=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/221=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/222=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/223=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/224=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/225=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/226=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/227=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/228=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/229=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/230=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/231=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/232=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/233=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/234=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/235=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/236=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/237=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/238=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/239=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/240=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/241=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/242=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/243=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/244=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/245=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/246=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/247=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/248=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/249=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/250=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/251=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/252=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/253=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/254=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/255=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/256=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/257=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/258=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/259=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/260=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/261=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/262=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/263=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/264=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/265=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/266=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/267=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/268=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/269=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/270=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/271=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/272=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/273=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/274=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/275=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/276=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/277=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/278=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/279=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/280=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/281=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/282=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/283=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/284=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/285=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/286=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/287=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/288=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/289=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/290=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/291=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/292=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/293=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/294=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/295=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/296=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/297=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/298=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/299=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/300=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/301=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/302=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/303=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/304=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/305=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/306=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/307=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/308=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/309=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/310=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/311=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/312=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/313=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/314=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/315=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/316=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/317=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/318=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/319=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/320=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/321=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/322=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/323=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/324=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/325=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/326=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/327=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/328=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/329=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/330=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/331=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/332=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/333=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/334=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/335=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/336=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/337=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/338=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/339=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/340=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/341=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/342=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/343=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/344=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/345=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/346=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/347=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/348=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/349=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/350=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/351=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/352=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/353=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/354=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/355=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/356=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/357=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/358=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/359=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/360=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/361=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/362=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/363=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/364=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/365=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/366=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/367=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/368=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/369=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/370=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/371=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/372=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/373=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/374=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/375=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/376=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/377=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/378=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/379=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/380=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/381=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/382=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/383=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/384=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/385=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/386=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/387=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/388=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/389=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/390=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/391=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/392=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/393=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/394=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/395=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/396=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/397=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/398=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/399=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/400=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/401=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/402=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/403=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/404=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/405=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/406=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/407=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/408=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/409=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/410=[#edits: 1 = ],208}, {t2_syncup/93e6956722d05ec4972c3a5270b9ac18/411=[#edits: 1 = ],208}], lastWalPath=hdfs://localhost.localdomain:33763/user/jenkins/test-data/cff26016-d918-437b-d046-4edb7b1c8347/oldWALs/jenkins-hbase20.apache.org%2C39045%2C1689186701549.1689186702074, lastWalPosition=35358, nbRowKeys=300, nbHFiles=0, heapSize=62400, lastSeqIds={}, endOfFile=true,usedBufferSize=62400] 2023-07-12 18:32:00,124 DEBUG [SinkThread-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:32:00,127 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:32:00,131 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=36857] regionserver.ReplicationSink(263): Started replicating mutations. 2023-07-12 18:32:00,131 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=36857] zookeeper.ReadOnlyZKClient(139): Connect 0x15273015 to 127.0.0.1:64028 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2023-07-12 18:32:00,135 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=36857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@1be0dcc1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:32:00,141 DEBUG [hconnection-0x1fdf5b65-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:32:00,142 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=ClientService 2023-07-12 18:32:00,175 DEBUG [RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=36857] regionserver.ReplicationSink(267): Finished replicating mutations. 2023-07-12 18:32:00,176 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1-jenkins-hbase20.apache.org,39045,1689186701549] replication.ReplicationQueueInfo(107): Found dead servers:[jenkins-hbase20.apache.org,39045,1689186701549] 2023-07-12 18:32:00,177 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.ReplicationSourceManager(580): Removing 1 logs in the list: [jenkins-hbase20.apache.org%2C39045%2C1689186701549.1689186702074] 2023-07-12 18:32:00,178 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.ReplicationSourceShipper(110): Shipper from source 1-jenkins-hbase20.apache.org,39045,1689186701549 got entry batch from reader: WALEntryBatch [walEntries=[], lastWalPath=null, lastWalPosition=0, nbRowKeys=0, nbHFiles=0, heapSize=0, lastSeqIds={}, endOfFile=false,usedBufferSize=0] 2023-07-12 18:32:00,178 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.RecoveredReplicationSourceShipper(50): Finished recovering queue for group jenkins-hbase20.apache.org%2C39045%2C1689186701549 of peer 1-jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:32:00,279 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.ReplicationSourceManager(453): Done with the recovered queue 1-jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:32:00,280 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): syncupReplication1689186715517-0x1008273886f0039, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/1/replication/rs/1689186715522.syncuptool.replication.org,1234,1/1-jenkins-hbase20.apache.org,39045,1689186701549 2023-07-12 18:32:00,280 INFO [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549.replicationSource.shipperjenkins-hbase20.apache.org%2C39045%2C1689186701549,1-jenkins-hbase20.apache.org,39045,1689186701549] regionserver.RecoveredReplicationSource(153): Finished recovering queue 1-jenkins-hbase20.apache.org,39045,1689186701549 with the following stats: Total replicated edits: 300, current progress: 2023-07-12 18:32:04,422 INFO [jenkins-hbase20:36857Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-12 18:32:04,422 INFO [jenkins-hbase20:36857Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Sink: age in ms of last applied edit: 0, total replicated edits: 300 2023-07-12 18:32:05,545 INFO [Listener at localhost.localdomain/40201] regionserver.ReplicationSource(656): peerId=1, Closing source 1 because: Region server is closing 2023-07-12 18:32:05,649 DEBUG [Listener at localhost.localdomain/40201.replicationSource,1-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f003b, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:32:05,649 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x015055cc to 127.0.0.1:64028 2023-07-12 18:32:05,650 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:32:05,782 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-12 18:32:05,853 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): syncupReplication1689186715517-0x1008273886f0039, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:32:05,853 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): syncupReplication1689186715517-0x1008273886f0039, quorum=127.0.0.1:64028, baseZNode=/1 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:32:05,863 INFO [Listener at localhost.localdomain/40201] replication.TestReplicationSyncUpTool(280): SyncUpAfterPut succeeded at retry = 0 2023-07-12 18:32:05,863 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 18:32:05,863 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21aeb980 to 127.0.0.1:64028 2023-07-12 18:32:05,863 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:32:05,864 DEBUG [Listener at localhost.localdomain/40201] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 18:32:05,864 DEBUG [Listener at localhost.localdomain/40201] util.JVMClusterUtil(257): Found active master hash=384535424, stopped=false 2023-07-12 18:32:05,864 INFO [Listener at localhost.localdomain/40201] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,37655,1689186709109 2023-07-12 18:32:05,865 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/running 2023-07-12 18:32:05,865 INFO [Listener at localhost.localdomain/40201] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 18:32:05,865 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/running 2023-07-12 18:32:05,866 DEBUG [Listener at localhost.localdomain/40201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x374ec826 to 127.0.0.1:64028 2023-07-12 18:32:05,867 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:32:05,867 DEBUG [Listener at localhost.localdomain/40201] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:32:05,868 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,36857,1689186709144' ***** 2023-07-12 18:32:05,868 INFO [Listener at localhost.localdomain/40201] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:32:05,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:32:05,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/running 2023-07-12 18:32:05,868 INFO [RS:0;jenkins-hbase20:36857] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:32:05,868 INFO [RS:0;jenkins-hbase20:36857] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:32:05,868 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:32:05,869 INFO [RS:0;jenkins-hbase20:36857] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:32:05,870 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(3305): Received CLOSE for 63272e89b8aafccb1ffb2f93ed48b12c 2023-07-12 18:32:05,870 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(3305): Received CLOSE for bde3b0e33054f5210b7a78be27604e3f 2023-07-12 18:32:05,870 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(3305): Received CLOSE for e22f590dd8a98a0fba12251b93336902 2023-07-12 18:32:05,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 63272e89b8aafccb1ffb2f93ed48b12c, disabling compactions & flushes 2023-07-12 18:32:05,871 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:32:05,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:32:05,871 DEBUG [RS:0;jenkins-hbase20:36857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38e3b82d to 127.0.0.1:64028 2023-07-12 18:32:05,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:32:05,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. after waiting 0 ms 2023-07-12 18:32:05,871 DEBUG [RS:0;jenkins-hbase20:36857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:32:05,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:32:05,871 INFO [RS:0;jenkins-hbase20:36857] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:32:05,871 INFO [RS:0;jenkins-hbase20:36857] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:32:05,871 INFO [RS:0;jenkins-hbase20:36857] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:32:05,872 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 18:32:05,880 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-07-12 18:32:05,880 DEBUG [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1478): Online Regions={63272e89b8aafccb1ffb2f93ed48b12c=hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c., bde3b0e33054f5210b7a78be27604e3f=t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f., 1588230740=hbase:meta,,1.1588230740, e22f590dd8a98a0fba12251b93336902=t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902.} 2023-07-12 18:32:05,881 DEBUG [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1504): Waiting on 1588230740, 63272e89b8aafccb1ffb2f93ed48b12c, bde3b0e33054f5210b7a78be27604e3f, e22f590dd8a98a0fba12251b93336902 2023-07-12 18:32:05,882 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 18:32:05,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 18:32:05,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 18:32:05,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 18:32:05,885 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 18:32:05,885 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=2.73 KB heapSize=5.24 KB 2023-07-12 18:32:05,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/namespace/63272e89b8aafccb1ffb2f93ed48b12c/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=12 2023-07-12 18:32:05,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:32:05,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 63272e89b8aafccb1ffb2f93ed48b12c: 2023-07-12 18:32:05,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689186677059.63272e89b8aafccb1ffb2f93ed48b12c. 2023-07-12 18:32:05,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bde3b0e33054f5210b7a78be27604e3f, disabling compactions & flushes 2023-07-12 18:32:05,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:32:05,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:32:05,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. after waiting 0 ms 2023-07-12 18:32:05,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:32:05,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing bde3b0e33054f5210b7a78be27604e3f 2/2 column families, dataSize=7.01 KB heapSize=22.38 KB 2023-07-12 18:32:05,920 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:32:05,929 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.73 KB at sequenceid=43 (bloomFilter=false), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/.tmp/info/7b65d4f1a0884055b6cba626b2f7d799 2023-07-12 18:32:05,939 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/.tmp/info/7b65d4f1a0884055b6cba626b2f7d799 as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info/7b65d4f1a0884055b6cba626b2f7d799 2023-07-12 18:32:05,945 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/info/7b65d4f1a0884055b6cba626b2f7d799, entries=24, sequenceid=43, filesize=7.4 K 2023-07-12 18:32:05,946 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.73 KB/2792, heapSize ~4.73 KB/4840, currentSize=0 B/0 for 1588230740 in 61ms, sequenceid=43, compaction requested=true 2023-07-12 18:32:05,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=7.01 KB at sequenceid=22 (bloomFilter=true), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/.tmp/cf1/b70e78a1ec4446ae94ef42044e1ce39e 2023-07-12 18:32:05,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/hbase/meta/1588230740/recovered.edits/46.seqid, newMaxSeqId=46, maxSeqId=34 2023-07-12 18:32:05,968 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 18:32:05,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 18:32:05,969 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 18:32:05,969 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 18:32:05,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/.tmp/cf1/b70e78a1ec4446ae94ef42044e1ce39e as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1/b70e78a1ec4446ae94ef42044e1ce39e 2023-07-12 18:32:05,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/cf1/b70e78a1ec4446ae94ef42044e1ce39e, entries=200, sequenceid=22, filesize=12.2 K 2023-07-12 18:32:05,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~7.01 KB/7180, heapSize ~22.11 KB/22640, currentSize=0 B/0 for bde3b0e33054f5210b7a78be27604e3f in 78ms, sequenceid=22, compaction requested=true 2023-07-12 18:32:05,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t2_syncup/bde3b0e33054f5210b7a78be27604e3f/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=18 2023-07-12 18:32:05,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:32:05,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bde3b0e33054f5210b7a78be27604e3f: 2023-07-12 18:32:05,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed t2_syncup,,1689186679605.bde3b0e33054f5210b7a78be27604e3f. 2023-07-12 18:32:05,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e22f590dd8a98a0fba12251b93336902, disabling compactions & flushes 2023-07-12 18:32:05,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:32:05,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:32:05,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. after waiting 0 ms 2023-07-12 18:32:05,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:32:05,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e22f590dd8a98a0fba12251b93336902 2/2 column families, dataSize=3.40 KB heapSize=11.44 KB 2023-07-12 18:32:06,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.40 KB at sequenceid=21 (bloomFilter=true), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/.tmp/cf1/8ed6e13125df449b99d8662e6ee5caa5 2023-07-12 18:32:06,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/.tmp/cf1/8ed6e13125df449b99d8662e6ee5caa5 as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1/8ed6e13125df449b99d8662e6ee5caa5 2023-07-12 18:32:06,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/cf1/8ed6e13125df449b99d8662e6ee5caa5, entries=100, sequenceid=21, filesize=8.3 K 2023-07-12 18:32:06,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.40 KB/3480, heapSize ~11.17 KB/11440, currentSize=0 B/0 for e22f590dd8a98a0fba12251b93336902 in 25ms, sequenceid=21, compaction requested=true 2023-07-12 18:32:06,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/data/default/t1_syncup/e22f590dd8a98a0fba12251b93336902/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=17 2023-07-12 18:32:06,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:32:06,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e22f590dd8a98a0fba12251b93336902: 2023-07-12 18:32:06,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed t1_syncup,,1689186678985.e22f590dd8a98a0fba12251b93336902. 2023-07-12 18:32:06,081 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,36857,1689186709144; all regions closed. 2023-07-12 18:32:06,089 DEBUG [RS:0;jenkins-hbase20:36857] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs 2023-07-12 18:32:06,089 INFO [RS:0;jenkins-hbase20:36857] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36857%2C1689186709144.meta:.meta(num 1689186709664) 2023-07-12 18:32:06,104 DEBUG [RS:0;jenkins-hbase20:36857] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/oldWALs 2023-07-12 18:32:06,105 INFO [RS:0;jenkins-hbase20:36857] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36857%2C1689186709144:(num 1689186709526) 2023-07-12 18:32:06,105 DEBUG [RS:0;jenkins-hbase20:36857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:32:06,105 INFO [RS:0;jenkins-hbase20:36857] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:32:06,105 INFO [RS:0;jenkins-hbase20:36857] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 18:32:06,105 DEBUG [RS:0;jenkins-hbase20:36857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15273015 to 127.0.0.1:64028 2023-07-12 18:32:06,105 DEBUG [RS:0;jenkins-hbase20:36857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:32:06,105 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:32:06,107 INFO [RS:0;jenkins-hbase20:36857] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36857 2023-07-12 18:32:06,112 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f0027, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:32:06,112 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/rs/jenkins-hbase20.apache.org,36857,1689186709144 2023-07-12 18:32:06,112 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:32:06,112 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:32:06,112 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:32:06,112 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f002a, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:32:06,112 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:32:06,112 DEBUG [ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549-EventThread] zookeeper.ZKWatcher(600): connection to cluster: 1-0x1008273886f003d, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2/rs 2023-07-12 18:32:06,113 INFO [zk-event-processor-pool-0] replication.HBaseReplicationEndpoint$PeerRegionServerListener(224): Detected change to peer region servers, fetching updated list 2023-07-12 18:32:06,212 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,36857,1689186709144] 2023-07-12 18:32:06,212 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,36857,1689186709144; numProcessing=1 2023-07-12 18:32:06,213 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /2/draining/jenkins-hbase20.apache.org,36857,1689186709144 already deleted, retry=false 2023-07-12 18:32:06,213 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,36857,1689186709144 expired; onlineServers=0 2023-07-12 18:32:06,213 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,37655,1689186709109' ***** 2023-07-12 18:32:06,213 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 18:32:06,215 DEBUG [M:0;jenkins-hbase20:37655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12d40d85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 18:32:06,215 INFO [M:0;jenkins-hbase20:37655] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,37655,1689186709109 2023-07-12 18:32:06,215 INFO [M:0;jenkins-hbase20:37655] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,37655,1689186709109; all regions closed. 2023-07-12 18:32:06,215 DEBUG [M:0;jenkins-hbase20:37655] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:32:06,215 DEBUG [M:0;jenkins-hbase20:37655] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 18:32:06,215 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 18:32:06,216 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186709335] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689186709335,5,FailOnTimeoutGroup] 2023-07-12 18:32:06,216 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186709334] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689186709334,5,FailOnTimeoutGroup] 2023-07-12 18:32:06,215 DEBUG [M:0;jenkins-hbase20:37655] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 18:32:06,218 INFO [M:0;jenkins-hbase20:37655] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 18:32:06,218 INFO [M:0;jenkins-hbase20:37655] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 18:32:06,218 INFO [M:0;jenkins-hbase20:37655] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-07-12 18:32:06,218 DEBUG [M:0;jenkins-hbase20:37655] master.HMaster(1512): Stopping service threads 2023-07-12 18:32:06,218 INFO [M:0;jenkins-hbase20:37655] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 18:32:06,219 ERROR [M:0;jenkins-hbase20:37655] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-12 18:32:06,219 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/2/master 2023-07-12 18:32:06,219 INFO [M:0;jenkins-hbase20:37655] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 18:32:06,219 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/2 2023-07-12 18:32:06,219 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 18:32:06,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Set watcher on znode that does not yet exist, /2/master 2023-07-12 18:32:06,219 DEBUG [M:0;jenkins-hbase20:37655] zookeeper.ZKUtil(398): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Unable to get data of znode /2/master because node does not exist (not an error) 2023-07-12 18:32:06,219 WARN [M:0;jenkins-hbase20:37655] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 18:32:06,219 INFO [M:0;jenkins-hbase20:37655] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 18:32:06,220 INFO [M:0;jenkins-hbase20:37655] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 18:32:06,221 DEBUG [M:0;jenkins-hbase20:37655] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 18:32:06,221 INFO [M:0;jenkins-hbase20:37655] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:32:06,221 DEBUG [M:0;jenkins-hbase20:37655] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:32:06,221 DEBUG [M:0;jenkins-hbase20:37655] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 18:32:06,221 DEBUG [M:0;jenkins-hbase20:37655] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:32:06,221 INFO [M:0;jenkins-hbase20:37655] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=26.46 KB heapSize=32.88 KB 2023-07-12 18:32:06,239 INFO [M:0;jenkins-hbase20:37655] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=26.46 KB at sequenceid=290 (bloomFilter=true), to=hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/59f52708c9b041d7a55b580f2c214a0f 2023-07-12 18:32:06,246 DEBUG [M:0;jenkins-hbase20:37655] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/59f52708c9b041d7a55b580f2c214a0f as hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/59f52708c9b041d7a55b580f2c214a0f 2023-07-12 18:32:06,251 INFO [M:0;jenkins-hbase20:37655] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41891/user/jenkins/test-data/4e54860e-690e-b9ae-b744-54be66fc9a27/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/59f52708c9b041d7a55b580f2c214a0f, entries=9, sequenceid=290, filesize=5.5 K 2023-07-12 18:32:06,252 INFO [M:0;jenkins-hbase20:37655] regionserver.HRegion(2948): Finished flush of dataSize ~26.46 KB/27098, heapSize ~32.86 KB/33648, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=290, compaction requested=true 2023-07-12 18:32:06,253 INFO [M:0;jenkins-hbase20:37655] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:32:06,253 DEBUG [M:0;jenkins-hbase20:37655] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:32:06,257 INFO [M:0;jenkins-hbase20:37655] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 18:32:06,257 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:32:06,258 INFO [M:0;jenkins-hbase20:37655] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:37655 2023-07-12 18:32:06,261 DEBUG [M:0;jenkins-hbase20:37655] zookeeper.RecoverableZooKeeper(172): Node /2/rs/jenkins-hbase20.apache.org,37655,1689186709109 already deleted, retry=false 2023-07-12 18:32:06,313 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:32:06,313 INFO [RS:0;jenkins-hbase20:36857] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,36857,1689186709144; zookeeper connection closed. 2023-07-12 18:32:06,313 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): regionserver:36857-0x1008273886f0034, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:32:06,315 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@46cb4217] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@46cb4217 2023-07-12 18:32:06,315 INFO [Listener at localhost.localdomain/40201] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-12 18:32:06,413 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:32:06,413 DEBUG [Listener at localhost.localdomain/40201-EventThread] zookeeper.ZKWatcher(600): master:37655-0x1008273886f0033, quorum=127.0.0.1:64028, baseZNode=/2 Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:32:06,413 INFO [M:0;jenkins-hbase20:37655] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,37655,1689186709109; zookeeper connection closed. 2023-07-12 18:32:06,415 WARN [Listener at localhost.localdomain/40201] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:32:06,422 INFO [Listener at localhost.localdomain/40201] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:32:06,535 WARN [BP-828525028-148.251.75.209-1689186675089 heartbeating to localhost.localdomain/127.0.0.1:41891] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 18:32:06,535 WARN [BP-828525028-148.251.75.209-1689186675089 heartbeating to localhost.localdomain/127.0.0.1:41891] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-828525028-148.251.75.209-1689186675089 (Datanode Uuid b88a26a9-93ac-4ef6-9992-0b46ee166647) service to localhost.localdomain/127.0.0.1:41891 2023-07-12 18:32:06,539 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/cluster_716fc7b6-48f9-c77a-dc76-2ce80ff5ed2b/dfs/data/data7/current/BP-828525028-148.251.75.209-1689186675089] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:06,539 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/cluster_716fc7b6-48f9-c77a-dc76-2ce80ff5ed2b/dfs/data/data8/current/BP-828525028-148.251.75.209-1689186675089] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:06,543 WARN [Listener at localhost.localdomain/40201] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:32:06,549 INFO [Listener at localhost.localdomain/40201] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:32:06,653 WARN [BP-828525028-148.251.75.209-1689186675089 heartbeating to localhost.localdomain/127.0.0.1:41891] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 18:32:06,653 WARN [BP-828525028-148.251.75.209-1689186675089 heartbeating to localhost.localdomain/127.0.0.1:41891] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-828525028-148.251.75.209-1689186675089 (Datanode Uuid 66359283-3779-4c6b-a692-aa44efb0e3ae) service to localhost.localdomain/127.0.0.1:41891 2023-07-12 18:32:06,654 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/cluster_716fc7b6-48f9-c77a-dc76-2ce80ff5ed2b/dfs/data/data5/current/BP-828525028-148.251.75.209-1689186675089] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:06,654 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/cluster_716fc7b6-48f9-c77a-dc76-2ce80ff5ed2b/dfs/data/data6/current/BP-828525028-148.251.75.209-1689186675089] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:06,658 WARN [Listener at localhost.localdomain/40201] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:32:06,662 INFO [Listener at localhost.localdomain/40201] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:32:06,685 WARN [BP-828525028-148.251.75.209-1689186675089 heartbeating to localhost.localdomain/127.0.0.1:41891] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-828525028-148.251.75.209-1689186675089 (Datanode Uuid c57c604e-bbe7-41ba-9589-9140b155f881) service to localhost.localdomain/127.0.0.1:41891 2023-07-12 18:32:06,686 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/cluster_716fc7b6-48f9-c77a-dc76-2ce80ff5ed2b/dfs/data/data3/current/BP-828525028-148.251.75.209-1689186675089] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:06,687 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/cluster_716fc7b6-48f9-c77a-dc76-2ce80ff5ed2b/dfs/data/data4/current/BP-828525028-148.251.75.209-1689186675089] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:06,769 WARN [Listener at localhost.localdomain/40201] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:32:06,773 INFO [Listener at localhost.localdomain/40201] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:32:06,878 WARN [BP-828525028-148.251.75.209-1689186675089 heartbeating to localhost.localdomain/127.0.0.1:41891] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 18:32:06,878 WARN [BP-828525028-148.251.75.209-1689186675089 heartbeating to localhost.localdomain/127.0.0.1:41891] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-828525028-148.251.75.209-1689186675089 (Datanode Uuid 7a793e7a-1f31-48dc-800a-27610c677e09) service to localhost.localdomain/127.0.0.1:41891 2023-07-12 18:32:06,879 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/cluster_716fc7b6-48f9-c77a-dc76-2ce80ff5ed2b/dfs/data/data1/current/BP-828525028-148.251.75.209-1689186675089] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:06,880 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5f5e7d74-4be7-d5d1-a2c5-e6df17e0374b/cluster_716fc7b6-48f9-c77a-dc76-2ce80ff5ed2b/dfs/data/data2/current/BP-828525028-148.251.75.209-1689186675089] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:06,912 INFO [Listener at localhost.localdomain/40201] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-12 18:32:07,090 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-12 18:32:07,090 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 18:32:07,090 WARN [Listener at localhost.localdomain/40201] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:32:07,092 INFO [Listener at localhost.localdomain/40201] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:32:07,174 WARN [BP-340224117-148.251.75.209-1689186668462 heartbeating to localhost.localdomain/127.0.0.1:33763] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-340224117-148.251.75.209-1689186668462 (Datanode Uuid b49455b8-bcda-4810-925a-cb679b05301f) service to localhost.localdomain/127.0.0.1:33763 2023-07-12 18:32:07,175 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/cluster_5a761d4b-073d-2fda-f65b-7c1d3c830910/dfs/data/data3/current/BP-340224117-148.251.75.209-1689186668462] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:07,176 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/cluster_5a761d4b-073d-2fda-f65b-7c1d3c830910/dfs/data/data4/current/BP-340224117-148.251.75.209-1689186668462] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:07,194 WARN [Listener at localhost.localdomain/40201] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:32:07,198 INFO [Listener at localhost.localdomain/40201] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:32:07,299 WARN [BP-340224117-148.251.75.209-1689186668462 heartbeating to localhost.localdomain/127.0.0.1:33763] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 18:32:07,300 WARN [BP-340224117-148.251.75.209-1689186668462 heartbeating to localhost.localdomain/127.0.0.1:33763] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-340224117-148.251.75.209-1689186668462 (Datanode Uuid a946c2f3-5bac-48a8-97af-732bed2d5f96) service to localhost.localdomain/127.0.0.1:33763 2023-07-12 18:32:07,301 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/cluster_5a761d4b-073d-2fda-f65b-7c1d3c830910/dfs/data/data1/current/BP-340224117-148.251.75.209-1689186668462] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:07,303 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/643d4288-5c48-98bf-628a-6c3a5d125153/cluster_5a761d4b-073d-2fda-f65b-7c1d3c830910/dfs/data/data2/current/BP-340224117-148.251.75.209-1689186668462] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:32:07,348 INFO [Listener at localhost.localdomain/40201] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-12 18:32:07,467 INFO [Listener at localhost.localdomain/40201] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 18:32:07,497 INFO [Listener at localhost.localdomain/40201] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-12 18:32:07,524 INFO [Listener at localhost.localdomain/40201] hbase.ResourceChecker(175): after: replication.TestReplicationSyncUpTool#testSyncUpTool Thread=192 (was 10) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x23e9f535 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$48/1872383570.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/40201 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost.localdomain:41891 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x487b9788-SendThread(127.0.0.1:64028) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.cleanAndNotifyState(ClientCnxn.java:1276) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1254) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x487b9788 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$48/1872383570.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x3d7503d3-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:33763 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-event-processor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1312596957) connection to localhost.localdomain/127.0.0.1:33763 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x4769220c-SendThread(127.0.0.1:64028) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.cleanAndNotifyState(ClientCnxn.java:1276) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1254) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: region-location-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@31cfe06b java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost.localdomain:41891 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1312596957) connection to localhost.localdomain/127.0.0.1:33763 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SinkThread-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost.localdomain:33763 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,39045,1689186701549-SendThread(127.0.0.1:64028) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.cleanAndNotifyState(ClientCnxn.java:1276) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1254) Potentially hanging thread: SinkThread-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,37271,1689186672154-SendThread(127.0.0.1:64028) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.cleanAndNotifyState(ClientCnxn.java:1276) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1254) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1312596957) connection to localhost.localdomain/127.0.0.1:41891 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost.localdomain:33763 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x23e9f535-SendThread(127.0.0.1:64028) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.cleanAndNotifyState(ClientCnxn.java:1276) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1254) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x3d7503d3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$48/1872383570.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-event-processor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x23e9f535-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x34bfb220-SendThread(127.0.0.1:64028) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.cleanAndNotifyState(ClientCnxn.java:1276) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1254) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1312596957) connection to localhost.localdomain/127.0.0.1:41891 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x34bfb220 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$48/1872383570.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x4769220c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$48/1872383570.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x487b9788-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost.localdomain:33763 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost.localdomain:41891 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:41891 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x4769220c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost.localdomain:41891 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SinkThread-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1312596957) connection to localhost.localdomain/127.0.0.1:41891 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x34bfb220-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64028@0x3d7503d3-SendThread(127.0.0.1:64028) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.cleanAndNotifyState(ClientCnxn.java:1276) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1254) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost.localdomain:41891 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost.localdomain:41891 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-event-processor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReplicationExecutor-0.replicationSource,1-jenkins-hbase20.apache.org,40805,1689186672112-SendThread(127.0.0.1:64028) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.cleanAndNotifyState(ClientCnxn.java:1276) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1254) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=654 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=150 (was 147) - SystemLoadAverage LEAK? -, ProcessCount=164 (was 164), AvailableMemoryMB=6382 (was 6955)